-- Logs begin at Thu 2022-07-28 02:35:01 UTC, end at Thu 2022-07-28 04:21:46 UTC. -- Jul 28 03:50:48.642195 dv-cinder-799871-47-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 03:50:48.651527 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 03:50:48.653614 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 03:50:48 2022] *** Jul 28 03:50:48.653614 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 03:50:48.653614 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 03:50:48.653614 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: nodename: dv-cinder-799871-47-iscsi Jul 28 03:50:48.653614 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: machine: x86_64 Jul 28 03:50:48.653614 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: clock source: unix Jul 28 03:50:48.653614 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: pcre jit disabled Jul 28 03:50:48.653614 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: detected number of CPU cores: 4 Jul 28 03:50:48.653614 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: current working directory: / Jul 28 03:50:48.653614 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: detected binary path: /usr/bin/uwsgi-core Jul 28 03:50:48.654324 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: your processes number limit is 47680 Jul 28 03:50:48.654324 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: your memory page size is 4096 bytes Jul 28 03:50:48.654324 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: detected max file descriptor number: 2048 Jul 28 03:50:48.654324 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: lock engine: pthread robust mutexes Jul 28 03:50:48.654324 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: thunder lock: enabled Jul 28 03:50:48.654324 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 03:50:48.654324 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 03:50:48.692988 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: Python main interpreter initialized at 0x555a92bb89c0 Jul 28 03:50:48.692988 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: python threads support enabled Jul 28 03:50:48.692988 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: your server socket listen backlog is limited to 100 connections Jul 28 03:50:48.692988 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: your mercy for graceful operations on workers is 90 seconds Jul 28 03:50:48.693311 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 03:50:48.693385 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: *** Operational MODE: preforking *** Jul 28 03:50:48.693644 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: *** uWSGI is running in multiple interpreter mode *** Jul 28 03:50:48.693644 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: spawned uWSGI master process (pid: 103455) Jul 28 03:50:48.693821 dv-cinder-799871-47-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 03:50:48.695159 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: spawned uWSGI worker 1 (pid: 103456, cores: 1) Jul 28 03:50:48.695159 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: spawned uWSGI worker 2 (pid: 103457, cores: 1) Jul 28 03:50:48.695159 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 03:50:49.361330 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 03:50:49.364964 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 03:50:50.458902 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:50:50.458902 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: from cryptography.utils import int_from_bytes Jul 28 03:50:50.459497 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:50:50.459497 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: from cryptography.utils import int_from_bytes Jul 28 03:50:50.465923 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:50:50.465923 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: from cryptography.utils import int_from_bytes Jul 28 03:50:50.466348 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:50:50.466348 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: from cryptography.utils import int_from_bytes Jul 28 03:50:53.004108 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 03:50:53.004711 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 03:50:53.004880 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 03:50:53.005240 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 03:50:53.005498 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 03:50:53.005781 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 03:50:53.006156 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.006241 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 03:50:53.006336 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.006499 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.006603 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 03:50:53.006840 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.006933 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 03:50:53.007157 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 03:50:53.007244 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.007469 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.007576 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.007788 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.007883 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.008107 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.008192 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.008432 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.008520 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.008692 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.008786 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.009007 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.009104 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.009330 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-47-iscsi {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.009423 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.009648 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.009734 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.010538 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.010670 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.010964 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.011080 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.011313 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.011540 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.011636 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.011874 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-47-iscsi {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.011969 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.012199 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.012292 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.012510 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.012727 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.012851 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.013131 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.013230 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.013436 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.013540 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.013758 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.013851 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.014067 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.014175 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.014397 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.014573 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.014707 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.014920 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.015065 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.015225 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.015353 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.015547 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.015670 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.015869 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.015962 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.016180 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.016357 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-47-iscsi {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.016484 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.016673 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.016802 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.017056 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.017153 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.017385 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.017477 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.017709 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.017806 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.018094 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.018178 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-47-iscsi {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.018405 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.018488 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.018714 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.018828 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.019052 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.019139 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.019368 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.019458 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.019695 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.019781 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.020015 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.020102 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.020334 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.020428 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.020656 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.020740 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.020957 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.021043 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.021268 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.021359 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.021575 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.021667 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.021889 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.021987 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.022191 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.022274 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.022493 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.022584 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.022740 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.022860 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.023115 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.023291 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.023433 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.023620 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.023735 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.023942 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.024027 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.024264 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.024378 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.024505 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.024614 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.024758 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.024874 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.025081 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.025195 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.025402 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.025510 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.026352 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.026455 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.026673 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.026883 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.027139 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.027288 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.027431 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.027572 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.027706 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.027838 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.027986 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.028117 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.028249 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.028431 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.028566 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.028743 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.028892 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.029051 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.029206 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.029358 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.029501 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.029662 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.029804 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.029967 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.030111 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.030285 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.030420 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.030600 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.030729 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.030933 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.031062 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.031242 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.031385 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.031597 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.031729 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.031859 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.031996 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.032177 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.032312 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.032482 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.032617 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.032788 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.032876 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.033094 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.033194 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.033398 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.033483 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.033716 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.033801 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.034040 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.034132 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.034342 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.034433 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.034860 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.034967 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.035178 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.035301 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.035484 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.035583 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.035803 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.035900 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.036108 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.036219 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.036367 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.036469 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.036665 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.036759 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.036966 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.037053 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.037273 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.037358 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.037576 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.037666 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.037875 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.037967 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.038177 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.038268 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.038475 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.038560 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.038777 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.038874 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.039100 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.039195 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.039404 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.039488 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.039705 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.039796 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.040007 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.040092 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.040308 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.040393 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.040610 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.040696 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.040912 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.041003 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.041274 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.041417 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.041590 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.041819 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.041949 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.042204 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.042296 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.042506 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.042602 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.042844 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.042936 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.043152 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.043238 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.043459 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.043554 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.043775 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.043861 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.044081 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.044176 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.044386 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.044478 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.044701 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.044784 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.044998 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.045082 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.045305 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.045412 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.045618 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.045714 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.045922 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.046018 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.046224 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.046320 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.046527 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.046635 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.046843 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.046940 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.047150 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.047252 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.047453 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.047550 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.047755 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.047850 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.048054 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.048156 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.048352 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.048449 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.048651 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.048754 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.048951 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.049055 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.049254 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.049365 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.049554 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.049668 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.049857 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.049963 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.050153 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.050257 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.050467 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.050583 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.050812 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.050925 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.051110 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.051209 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.051414 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.051515 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.051715 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.051808 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.052029 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:50:53.052115 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.052362 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.052450 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.052692 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.052786 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.053004 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.053090 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.053328 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.053422 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.053640 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.053738 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.053951 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.054037 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.054262 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.054350 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.054572 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.054664 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.054909 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.055023 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.055232 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.055319 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.055543 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.055651 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.055854 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.055968 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.056160 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.056247 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.056468 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.056602 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.056779 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.056879 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.057129 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.057316 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.057510 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.057683 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.057771 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.058004 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.058100 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.058324 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.058411 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.058636 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.058722 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.058981 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.059086 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.059308 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.059396 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.059628 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.059727 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.059936 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.060025 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.060241 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.060327 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.060564 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.060659 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.060894 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.060981 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.061208 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.061307 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.061523 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.061623 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.061833 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.061922 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.062141 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.062227 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.062449 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.062546 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.062760 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.062881 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.063093 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.063181 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.063408 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.063505 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.063725 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.063812 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.064041 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.064128 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.064346 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.064441 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.064653 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.064740 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.064962 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.065062 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.065266 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.065355 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.065572 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.065659 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.065877 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.065964 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.066180 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.066269 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.066483 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.066577 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.066828 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.066936 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.067123 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.067213 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.067429 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.067522 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.067737 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.067837 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.068039 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.068137 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.068341 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.068428 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.068641 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.068743 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.068947 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.069091 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.069260 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.069350 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.069549 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.069645 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.069850 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.069936 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.070160 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.070246 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.070470 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.070569 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.070773 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.070883 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.071115 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.071228 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.071422 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.071520 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.071723 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.071815 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.072022 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.072107 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.072329 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.072949 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.073157 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.073454 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.073545 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.073815 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.073952 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.074126 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.074287 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.074420 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.074610 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.074736 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.074948 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.075091 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.075274 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.075388 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.075582 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.075699 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.075887 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.076032 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.076204 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.076363 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.076516 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.076668 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.076828 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.076993 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.077139 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.077316 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.077448 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.077632 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.077769 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.077933 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.078078 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.078239 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.078389 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.078542 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.078720 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.078867 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.079076 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.079198 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.079382 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.079482 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.079706 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.079795 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.080029 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.080115 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.080330 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.080416 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.080629 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.080714 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.080929 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.081014 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.081229 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.081316 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.081532 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.081630 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.081832 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.081927 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.082132 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.082220 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.082429 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.082514 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.082730 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.082861 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.083053 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.083142 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.083351 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.083445 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.083649 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.083745 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.083968 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.084056 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.084275 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.084362 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.084582 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.084678 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.084885 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.084983 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.085183 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.085277 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.085521 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.085617 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.085821 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.085908 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.086128 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.086213 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.086447 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.086543 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.086757 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.086911 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.087097 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.087186 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.087405 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.087491 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.087716 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.087811 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.088023 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.088677 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.088901 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.089056 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.089368 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.089502 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.089707 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.089821 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.090053 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.090152 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.090389 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.090480 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.090707 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.090813 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.091056 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.091145 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.091369 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.091457 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.091685 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.091774 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.091995 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.092094 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.092297 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.092382 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.092603 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.092696 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.092913 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.093000 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.093229 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.093323 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.093539 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.093641 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.093854 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.093947 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.094159 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.094254 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.094476 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.094574 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.094833 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.094923 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.095111 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.095200 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.095415 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.095512 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.095721 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.095806 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.096036 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.096133 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.096344 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.096433 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.096657 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.096751 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.096964 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.097058 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.097282 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.097367 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.097586 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.097671 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.097894 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.097985 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.098194 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.098280 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.098497 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.098581 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.098828 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.098930 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.099144 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.099231 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.099453 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.099545 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.099763 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.099858 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.100073 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.100159 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.100380 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.100466 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.100685 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.100779 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.100991 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.101076 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.101291 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.101377 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.101590 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.101683 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.101896 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.101982 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.102209 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.102297 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.102516 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.102610 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.102844 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.102934 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.103150 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.103246 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.103464 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.103559 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.103815 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.103936 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.104240 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.104382 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.104538 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.104735 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.104887 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.105050 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.105138 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.105372 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.105469 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.105683 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.105778 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.106006 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.106097 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.106329 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.106429 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.106632 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.106726 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.106964 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.107053 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.107281 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.107394 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.107585 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.107672 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.107886 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.107974 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.108190 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.108279 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.108492 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.108579 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.108807 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.108892 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.109117 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.109205 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.109420 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.109555 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.109729 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.109816 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.110037 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.110125 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.110345 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.110431 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.110658 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.110745 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.110990 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.111078 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.111297 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.111384 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.111605 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.111770 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.111909 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.112005 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.112215 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.112302 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.112526 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.112621 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.112835 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.113143 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.113452 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.113550 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.113771 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.113868 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.114078 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.114165 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.114392 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.114488 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.114701 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.114816 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.115028 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.115117 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.115338 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.115438 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.115654 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.115742 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.116046 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.116212 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.116355 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.116542 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.116665 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.116855 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.116972 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.117173 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.117259 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.117488 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.117576 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.117804 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.117892 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.118131 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.118239 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.118455 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.118549 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.118863 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.118968 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.119114 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.119202 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.119978 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.120078 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.120285 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.120552 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.120641 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.120895 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.120991 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.121202 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.121302 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.121514 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.121609 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.121820 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.121914 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.122144 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.122232 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.122454 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.122540 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.122756 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.122862 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.123081 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.123180 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.123384 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.123477 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.123688 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.123776 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.124004 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.124103 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.124308 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.124395 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.124616 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.124740 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.124926 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.125023 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.125249 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.125344 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.125559 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.125646 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.125862 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.125958 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.126166 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.126294 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.126466 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.126552 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.126767 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.126906 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.127096 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.127228 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.127406 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.127497 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.127709 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.127798 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.128020 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.128116 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.128328 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.128416 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.128639 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.128734 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.128950 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.129038 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.129249 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.129335 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.129554 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.129643 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.129853 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.129952 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.130163 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.130270 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.130464 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.130558 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.130762 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.130913 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.131094 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.131200 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.131401 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.131496 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.131706 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.131792 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.132008 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.132104 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.132306 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.132399 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.132607 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.132692 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.132905 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.133001 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.133210 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.133297 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.133511 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.133599 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.133809 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.133896 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.134108 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.134195 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.134414 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.134499 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.134716 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.134858 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.135115 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.135208 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.135429 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.135660 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.135765 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.135969 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.136057 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.136285 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.136421 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.136588 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.136750 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.136889 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.136977 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.137191 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.137281 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.137501 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.137605 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.137807 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.137895 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.138106 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.138198 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.138415 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.138511 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.138719 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.138836 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.139046 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.139133 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.139346 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.139433 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.139650 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.139736 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.139949 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.140035 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.140248 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.140346 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.140544 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.140630 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.140845 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.140942 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.141146 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.141234 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.141442 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.141528 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.141750 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.141846 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.142051 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.142137 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.142349 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.142442 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.142649 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.142747 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.142976 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.143064 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.143274 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.143361 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.143576 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.143672 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.143874 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.143963 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.144174 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.144262 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.144474 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.144563 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.144800 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.144887 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.145107 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.145200 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.145407 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.145495 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.145708 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.145845 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.146008 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.146103 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.146325 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.146411 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.146634 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.146730 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.146959 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.147063 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.147267 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.147355 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.147589 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.147676 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.147900 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.147996 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.148210 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.148295 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.148521 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.148608 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.148833 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.148930 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.149135 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.149224 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.149440 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.149526 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.149743 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.149838 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.150051 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.150137 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.150352 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.150451 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.151210 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.151320 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.151599 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.151811 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.151899 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.152197 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.152285 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.152509 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.152595 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.152820 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.152916 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.153133 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.153229 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.153440 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.153527 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.153746 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.153840 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.154057 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.154184 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.154366 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.154502 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.154674 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.154868 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.155004 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.155179 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.155310 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.155485 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.155620 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.155814 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.155913 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.156109 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.156227 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.156422 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.156541 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.156730 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.156832 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.157141 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.157229 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.157451 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.157545 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.157759 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.157863 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.158059 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.158146 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.158371 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.158467 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.158677 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.158805 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.159005 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.159098 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.159313 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.159409 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.159867 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.159969 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.160174 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.160273 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.160476 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.160571 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.160878 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.160965 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.161190 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.161277 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.161495 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.161590 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.161795 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.161890 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.162101 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.162194 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.162405 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.162492 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.162712 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.162841 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.163039 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.163136 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.163341 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.163439 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.163659 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.163747 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.163962 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.164056 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.164282 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.164383 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.164639 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.164732 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.164942 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.165041 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.165248 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.165349 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.165553 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.165679 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.165873 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.166001 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.166355 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.166540 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.166675 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.166934 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.167125 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.167270 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.167454 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.167594 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.167767 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.167918 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.168082 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.168239 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.168388 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.168614 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.168765 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.168928 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.169065 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.169231 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.169379 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.169618 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.169774 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.169919 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.170054 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.170234 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.170372 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.170553 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.170694 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.170898 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.171002 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.171220 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.171306 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.171522 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.171617 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.171835 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.171943 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.172144 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.172254 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.172465 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.172574 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.172786 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.172899 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.173096 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.173191 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.173410 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.173499 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.173713 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.173800 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.174031 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.174120 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.174350 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.174445 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.174663 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.174760 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.174998 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.175084 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.175313 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.175409 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.175625 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.175713 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.175940 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.176035 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.176248 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.176362 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.176552 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.176640 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.176875 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.177047 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.177179 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.177268 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.177500 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.177587 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.177805 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.177951 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.178109 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.178206 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.178430 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.178525 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.178732 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.178852 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.179072 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.179162 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.179381 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.179474 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.179684 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.179771 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.179987 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.180074 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.180288 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.180377 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.180608 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.180696 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.180908 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.180996 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.181225 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.181320 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.181536 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.181625 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.182370 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.182516 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.182822 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.182913 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.183170 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.183367 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.183503 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.183698 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.183823 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.184011 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.184143 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.184317 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.184472 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.184624 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.184777 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.184929 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.185081 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.185273 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.185394 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.185579 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.185699 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.185905 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.185994 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.186251 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.186390 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.186562 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.186660 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.186895 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.186998 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.187200 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.187287 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.187502 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.187598 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.187825 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.187924 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.188130 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.188226 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.188450 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.188546 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.188751 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.188838 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.189052 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.189145 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.189358 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.189453 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.189656 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.189749 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.189960 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.190046 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.190261 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.190357 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.190568 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.190674 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.190892 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.190985 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.191196 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.191285 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.191497 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.191585 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.191816 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.191904 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.192120 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.192208 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.192438 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.192526 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.192745 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.192833 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.193047 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.193142 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.193351 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.193439 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.193649 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.193738 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.193981 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.194069 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.194279 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.194372 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.194595 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.194688 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.194933 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.195025 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.195250 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.195335 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.195569 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.195666 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.195883 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.196087 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.196204 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.196421 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.196508 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.196737 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.196832 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.197049 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.197137 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.197363 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.197506 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.197754 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.197966 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.198053 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.198341 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.198439 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.198661 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.198758 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.198997 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.199097 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.199309 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.199409 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.199624 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.199719 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.199942 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.200030 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.200265 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.200462 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.200598 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.200790 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.200923 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.201104 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.201219 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.201417 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.201534 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.201730 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.201850 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.202042 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.202204 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.202355 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.202518 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.202666 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.202848 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.203003 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.203166 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.203314 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.203482 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.203622 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.203797 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.203945 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.204107 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.204266 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.204417 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.204589 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.204732 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.204923 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.205044 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.205237 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.205356 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.205553 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.205667 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.205873 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.205969 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.206185 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.206285 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.206538 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.206628 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.206876 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.206978 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.207184 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.207274 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.207497 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.207585 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.207812 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.207908 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.208124 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.208259 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.208434 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.208659 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.208748 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.208977 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.209064 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.209307 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.209394 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.209631 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.209720 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.209938 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.210025 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.210251 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.210338 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.210565 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.210652 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.210912 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.211056 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.211215 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.211302 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.211516 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.211605 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.211827 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.211916 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.212135 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.212231 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.212437 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.212570 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.212757 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.212956 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.213576 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.213884 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.214057 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.214344 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.214432 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.214660 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.214746 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.215049 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.215218 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.215366 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.215565 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.215681 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.215883 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.216008 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.216208 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.216319 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.216532 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.216671 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.216856 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.216945 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.217164 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.217294 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.217488 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.217576 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.217795 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.217884 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.218099 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.218187 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.218399 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.218496 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.218708 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.218897 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.219041 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.219128 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.219407 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.219570 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.219725 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.219910 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.220036 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.220229 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.220325 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.220553 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.220643 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.220877 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.220965 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.221194 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.221291 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.221498 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.221588 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.221814 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.221899 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.222115 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.222210 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.222420 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.222508 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.222721 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.222825 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.223050 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.223149 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.223351 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.223438 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.223649 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.223736 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.223955 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.224049 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.224254 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.224340 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.224552 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.224638 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.224854 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.224960 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.225153 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.225239 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.225453 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.225546 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.225762 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.225863 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.226062 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.226154 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.226368 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.226456 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.226679 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.226847 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.227007 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.227096 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.227309 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.227403 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.227613 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.227711 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.227914 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.228003 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.228223 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.228310 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.228523 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.228615 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.228922 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.229025 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.229358 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.229491 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.229827 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.229915 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.230136 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.230223 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.230448 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.230544 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.230827 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.230920 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.231147 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.231235 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.231456 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.231554 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.231761 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.231850 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.232069 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.232162 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.232378 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.232473 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.232696 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.232783 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.233004 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.233090 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.233312 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.233408 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.233624 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.233710 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.233935 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.234023 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.234245 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.234475 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.234564 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.234828 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.234919 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.235153 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.235251 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.235470 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.235569 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.235779 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.235874 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.236088 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.236184 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.236396 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.236483 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.236701 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.236795 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.237017 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.237106 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.237327 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.237413 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.237638 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.237736 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.237947 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.238044 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.238258 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.238345 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.238564 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.238649 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.238895 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.238989 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.239203 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.239289 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.239508 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.239612 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.239814 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.239901 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.240121 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.240215 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.240428 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.240525 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.240737 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.240825 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.241039 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.241177 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.241342 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.241443 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.241653 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.241749 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.241989 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.242077 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.242305 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.242407 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.242619 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.242707 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.242956 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.243045 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.243272 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.243362 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.243580 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.243677 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.243887 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.243982 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.244194 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.244788 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.245089 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.245178 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.245458 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.245771 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.245880 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.246096 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.246190 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.246403 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.246500 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.246708 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.246847 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.247039 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.247156 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.247354 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.247470 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.247671 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.247790 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.247979 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.248112 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.248282 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.248424 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.248583 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.248745 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.248894 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.249067 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.249197 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.249379 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.249502 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.249700 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.249787 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.250012 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.250099 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.250338 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.250435 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.250672 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.250759 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.250999 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.251090 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.251300 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.251425 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.251602 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.251690 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.251900 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.251997 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.252199 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.252286 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.252505 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.252592 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.252806 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.252903 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.253108 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.253197 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.253406 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.253499 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.253704 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.253808 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.254000 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.254092 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.254345 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.254446 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.254601 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.254703 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.254939 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.255029 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.255226 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.255314 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.255532 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.255621 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.255832 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.255919 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.256133 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.256220 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.256433 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.256522 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.256736 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.256823 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.257037 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.257124 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.257337 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.257425 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.257639 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.257727 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.257938 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.258026 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.258239 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.258327 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.258539 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.258634 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.258861 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.258956 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.259162 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.259252 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.259486 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.259574 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.259811 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.259935 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.260192 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.260329 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.260494 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.260819 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.260905 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.261134 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.261223 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.261453 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.261541 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.261768 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.261856 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.262077 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.262168 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.262405 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.262494 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.262713 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.262832 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.263048 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.263176 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.263360 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.263451 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.263670 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.263767 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.263979 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.264065 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.264288 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.264377 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.264595 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.264689 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.264903 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.264998 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.265211 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.265296 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.265522 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.265621 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.265846 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.265932 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.266151 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.266237 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.266461 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.266549 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.266777 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.266915 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.267120 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.267208 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.267438 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.267527 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.267747 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.267834 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.268075 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.268175 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.268384 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.268472 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.268692 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.268780 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.268998 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.269094 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.269300 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.269386 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.269546 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103457) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 03:50:53.269641 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.269904 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.270209 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.270516 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.270847 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.271161 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.271486 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.271808 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.272114 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.272435 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.272757 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.273097 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.273408 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.273750 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.274084 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.274396 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.274707 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.275037 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:50:53.275278 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103456) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 03:50:53.424600 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO dbcounter [None req-b8d4d888-dc8c-4988-9d17-ee3bf9735e0b None None] Registered counter for database nova_api Jul 28 03:50:53.431676 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO dbcounter [None req-65c04a46-a2cb-498d-809e-e232490047d4 None None] Registered counter for database nova_api Jul 28 03:50:53.447267 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG oslo_db.sqlalchemy.engines [None req-b8d4d888-dc8c-4988-9d17-ee3bf9735e0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:50:53.452970 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG oslo_db.sqlalchemy.engines [None req-65c04a46-a2cb-498d-809e-e232490047d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:50:53.454464 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG dbcounter [-] [103457] Writer thread running {{(pid=103457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:50:53.459401 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writer thread running {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:50:53.511381 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.context [None req-b8d4d888-dc8c-4988-9d17-ee3bf9735e0b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),914ca376-756b-4795-b8c4-6a0f18f31607(cell1) {{(pid=103457) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 03:50:53.515309 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG oslo_concurrency.lockutils [None req-b8d4d888-dc8c-4988-9d17-ee3bf9735e0b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:53.516572 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.context [None req-65c04a46-a2cb-498d-809e-e232490047d4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),914ca376-756b-4795-b8c4-6a0f18f31607(cell1) {{(pid=103456) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 03:50:53.516887 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG oslo_concurrency.lockutils [None req-b8d4d888-dc8c-4988-9d17-ee3bf9735e0b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:53.517694 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG oslo_concurrency.lockutils [None req-b8d4d888-dc8c-4988-9d17-ee3bf9735e0b None None] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:53.519698 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG oslo_concurrency.lockutils [None req-b8d4d888-dc8c-4988-9d17-ee3bf9735e0b None None] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103457) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:53.520528 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-65c04a46-a2cb-498d-809e-e232490047d4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:53.521673 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO dbcounter [None req-b8d4d888-dc8c-4988-9d17-ee3bf9735e0b None None] Registered counter for database nova_cell0 Jul 28 03:50:53.522111 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-65c04a46-a2cb-498d-809e-e232490047d4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:53.522925 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-65c04a46-a2cb-498d-809e-e232490047d4 None None] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:50:53.524891 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-65c04a46-a2cb-498d-809e-e232490047d4 None None] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:50:53.527487 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO dbcounter [None req-b8d4d888-dc8c-4988-9d17-ee3bf9735e0b None None] Registered counter for database nova_cell1 Jul 28 03:50:53.527597 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO dbcounter [None req-65c04a46-a2cb-498d-809e-e232490047d4 None None] Registered counter for database nova_cell0 Jul 28 03:50:53.533160 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO dbcounter [None req-65c04a46-a2cb-498d-809e-e232490047d4 None None] Registered counter for database nova_cell1 Jul 28 03:50:53.536884 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG oslo_db.sqlalchemy.engines [None req-b8d4d888-dc8c-4988-9d17-ee3bf9735e0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:50:53.536884 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG oslo_db.sqlalchemy.engines [None req-b8d4d888-dc8c-4988-9d17-ee3bf9735e0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:50:53.540328 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG oslo_db.sqlalchemy.engines [None req-65c04a46-a2cb-498d-809e-e232490047d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:50:53.546201 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG dbcounter [-] [103457] Writer thread running {{(pid=103457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:50:53.546332 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writer thread running {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:50:53.546542 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG dbcounter [-] [103457] Writer thread running {{(pid=103457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:50:53.550501 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG oslo_db.sqlalchemy.engines [None req-65c04a46-a2cb-498d-809e-e232490047d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:50:53.691691 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writer thread running {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:50:53.692548 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO dbcounter [None req-b8d4d888-dc8c-4988-9d17-ee3bf9735e0b None None] Registered counter for database nova_cell0 Jul 28 03:50:53.699253 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG oslo_db.sqlalchemy.engines [None req-b8d4d888-dc8c-4988-9d17-ee3bf9735e0b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103457) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:50:53.700996 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO dbcounter [None req-65c04a46-a2cb-498d-809e-e232490047d4 None None] Registered counter for database nova_cell0 Jul 28 03:50:53.703853 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG dbcounter [-] [103457] Writer thread running {{(pid=103457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:50:53.707752 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG oslo_db.sqlalchemy.engines [None req-65c04a46-a2cb-498d-809e-e232490047d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103456) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:50:53.711960 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writer thread running {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:50:54.048294 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: WARNING keystonemiddleware.auth_token [None req-65c04a46-a2cb-498d-809e-e232490047d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:50:54.048935 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: WARNING keystonemiddleware.auth_token [None req-b8d4d888-dc8c-4988-9d17-ee3bf9735e0b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:50:54.055595 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: WARNING keystonemiddleware.auth_token [None req-65c04a46-a2cb-498d-809e-e232490047d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:50:54.056044 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: WARNING keystonemiddleware.auth_token [None req-b8d4d888-dc8c-4988-9d17-ee3bf9735e0b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:50:54.402420 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: WARNING keystonemiddleware.auth_token [None req-b8d4d888-dc8c-4988-9d17-ee3bf9735e0b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:50:54.405622 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: WARNING keystonemiddleware.auth_token [None req-65c04a46-a2cb-498d-809e-e232490047d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:50:54.408327 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: WARNING keystonemiddleware.auth_token [None req-b8d4d888-dc8c-4988-9d17-ee3bf9735e0b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:50:54.411842 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: WARNING keystonemiddleware.auth_token [None req-65c04a46-a2cb-498d-809e-e232490047d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:50:54.413876 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555a92bb89c0 pid: 103457 (default app) Jul 28 03:50:54.415970 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-b8d4d888-dc8c-4988-9d17-ee3bf9735e0b None None] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:50:54.417187 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-b8d4d888-dc8c-4988-9d17-ee3bf9735e0b None None] 10.222.0.46 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001747 Jul 28 03:50:54.417526 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x555a92bb89c0 pid: 103456 (default app) Jul 28 03:50:54.417612 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 1/1] 10.222.0.46 () {50 vars in 788 bytes} [Thu Jul 28 03:50:54 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:10.669822 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-65c04a46-a2cb-498d-809e-e232490047d4 None None] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:10.672043 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-65c04a46-a2cb-498d-809e-e232490047d4 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002985 Jul 28 03:52:10.672855 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 1/2] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 03:52:10 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:10.685006 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG dbcounter [-] [103457] Writing DB stats nova_api:SELECT=3 {{(pid=103457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:10.686162 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG dbcounter [-] [103457] Writing DB stats nova_cell0:SELECT=3 {{(pid=103457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:10.686991 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG dbcounter [-] [103457] Writing DB stats nova_cell1:SELECT=3 {{(pid=103457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:10.688277 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG dbcounter [-] [103457] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:11.554596 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-8001331f-94d8-4b01-bc02-5738a7a39334 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:11.589623 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-8001331f-94d8-4b01-bc02-5738a7a39334 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.910460 Jul 28 03:52:11.590380 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 2/3] 10.222.0.46 () {60 vars in 1291 bytes} [Thu Jul 28 03:52:10 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 912 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:13.947875 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-65c04a46-a2cb-498d-809e-e232490047d4 None None] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:13.948802 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-65c04a46-a2cb-498d-809e-e232490047d4 None None] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 Jul 28 03:52:13.949207 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 2/4] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 03:52:13 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:14.389173 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-859eda33-718a-46c9-a49d-5336a018b4a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "id": "c1", "ram": 256, "name": "cirros256", "rxtx_factor": 1.0, "swap": 0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:14.412587 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:52:14.412587 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: warnings.warn(msg) Jul 28 03:52:14.441119 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-859eda33-718a-46c9-a49d-5336a018b4a0 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.485790 Jul 28 03:52:14.441688 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 3/5] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jul 28 03:52:13 2022] POST /compute/v2.1/flavors => generated 407 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:52:14.459070 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writing DB stats nova_api:SELECT=3 {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:14.460124 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writing DB stats nova_cell0:SELECT=3 {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:14.462810 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writing DB stats nova_cell1:SELECT=3 {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:14.463895 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:14.682058 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-2390cf11-9bbe-456e-a995-4afa35986228 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:14.686906 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:52:14.686906 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: warnings.warn(msg) Jul 28 03:52:14.756349 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-2390cf11-9bbe-456e-a995-4afa35986228 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.305406 Jul 28 03:52:14.757165 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 3/6] 10.222.0.46 () {64 vars in 1335 bytes} [Thu Jul 28 03:52:14 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:16.955025 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-859eda33-718a-46c9-a49d-5336a018b4a0 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:16.956032 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-859eda33-718a-46c9-a49d-5336a018b4a0 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Jul 28 03:52:16.956618 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 4/7] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 03:52:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:17.615611 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-f15f5d64-1b60-47e5-b8b3-bbded57cb505 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d1", "swap": 0, "ram": 512, "rxtx_factor": 1.0, "name": "ds512M", "os-flavor-access:is_public": true}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:17.635532 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:52:17.635532 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: warnings.warn(msg) Jul 28 03:52:17.656396 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-f15f5d64-1b60-47e5-b8b3-bbded57cb505 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.693656 Jul 28 03:52:17.657375 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 4/8] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jul 28 03:52:16 2022] POST /compute/v2.1/flavors => generated 404 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:52:17.670145 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-e1734507-e5ba-4ab9-ac33-2cb6d04b35c7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:17.673043 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:52:17.673043 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: warnings.warn(msg) Jul 28 03:52:17.707482 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-e1734507-e5ba-4ab9-ac33-2cb6d04b35c7 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041041 Jul 28 03:52:17.708073 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 5/9] 10.222.0.46 () {64 vars in 1335 bytes} [Thu Jul 28 03:52:17 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:20.004051 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-f15f5d64-1b60-47e5-b8b3-bbded57cb505 admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:20.005077 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-f15f5d64-1b60-47e5-b8b3-bbded57cb505 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Jul 28 03:52:20.005709 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 5/10] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 03:52:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:20.357727 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-3b58032f-7e7f-4b0f-8a27-642e1ec8b248 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 10, "vcpus": 1, "id": "d2", "ram": 1024, "name": "ds1G"}} {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:20.376709 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-3b58032f-7e7f-4b0f-8a27-642e1ec8b248 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.364978 Jul 28 03:52:20.377392 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 6/11] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jul 28 03:52:20 2022] POST /compute/v2.1/flavors => generated 404 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:52:20.389933 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-175dfd69-67d6-4b43-b1a2-f6c0d163396e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:20.413998 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-175dfd69-67d6-4b43-b1a2-f6c0d163396e admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027819 Jul 28 03:52:20.415912 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 6/12] 10.222.0.46 () {64 vars in 1335 bytes} [Thu Jul 28 03:52:20 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:22.636042 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-3b58032f-7e7f-4b0f-8a27-642e1ec8b248 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:22.637234 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-3b58032f-7e7f-4b0f-8a27-642e1ec8b248 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001603 Jul 28 03:52:22.637712 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 7/13] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 03:52:22 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:23.060384 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-20592be2-e028-431f-9452-fb38489e4e64 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "swap": 0, "id": "d3", "ram": 2048}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:23.079782 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-20592be2-e028-431f-9452-fb38489e4e64 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.433635 Jul 28 03:52:23.087698 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 7/14] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jul 28 03:52:22 2022] POST /compute/v2.1/flavors => generated 404 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:52:23.092638 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-b2043807-dfe2-4555-9ed6-34d5e3458be7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:23.116578 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-b2043807-dfe2-4555-9ed6-34d5e3458be7 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027603 Jul 28 03:52:23.118385 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 8/15] 10.222.0.46 () {64 vars in 1335 bytes} [Thu Jul 28 03:52:23 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:25.366192 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-20592be2-e028-431f-9452-fb38489e4e64 admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:25.368402 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-20592be2-e028-431f-9452-fb38489e4e64 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002630 Jul 28 03:52:25.368974 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 8/16] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 03:52:25 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:25.809515 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-652b8156-1682-4109-95f0-52fd50271dd1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "id": "d4", "disk": 20, "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "name": "ds4G"}} {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:25.830431 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-652b8156-1682-4109-95f0-52fd50271dd1 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.455556 Jul 28 03:52:25.838191 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 9/17] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jul 28 03:52:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:52:25.843062 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-46ad8cd2-bdd4-4a56-8e22-2b8c317a14d0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:25.868109 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-46ad8cd2-bdd4-4a56-8e22-2b8c317a14d0 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028017 Jul 28 03:52:25.869110 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 9/18] 10.222.0.46 () {64 vars in 1335 bytes} [Thu Jul 28 03:52:25 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:28.119016 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-652b8156-1682-4109-95f0-52fd50271dd1 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:28.120049 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-652b8156-1682-4109-95f0-52fd50271dd1 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001572 Jul 28 03:52:28.120455 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 10/19] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 03:52:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:28.553255 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-ca563837-4260-4007-bd98-2d1ef0cf1bf8 admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:28.585118 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-ca563837-4260-4007-bd98-2d1ef0cf1bf8 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.458296 Jul 28 03:52:28.586479 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 10/20] 10.222.0.46 () {60 vars in 1291 bytes} [Thu Jul 28 03:52:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:52:30.826398 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-652b8156-1682-4109-95f0-52fd50271dd1 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:30.827472 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-652b8156-1682-4109-95f0-52fd50271dd1 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jul 28 03:52:30.827831 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 11/21] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 03:52:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:31.283901 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-3c97641e-8a60-4112-84bc-171b30ef677f admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "1", "name": "m1.tiny", "rxtx_factor": 1.0, "disk": 1, "ram": 512, "vcpus": 1}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:31.303074 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-3c97641e-8a60-4112-84bc-171b30ef677f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.469208 Jul 28 03:52:31.303632 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 11/22] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jul 28 03:52:30 2022] POST /compute/v2.1/flavors => generated 402 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:52:31.315711 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-761ca1a5-5a7d-4b61-9d9c-cb780c9765e4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:31.340789 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-761ca1a5-5a7d-4b61-9d9c-cb780c9765e4 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028844 Jul 28 03:52:31.341636 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 12/23] 10.222.0.46 () {64 vars in 1332 bytes} [Thu Jul 28 03:52:31 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:33.539141 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-3c97641e-8a60-4112-84bc-171b30ef677f admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:33.540670 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-3c97641e-8a60-4112-84bc-171b30ef677f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001999 Jul 28 03:52:33.541078 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 12/24] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 03:52:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:33.936036 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-cd88b3c4-fa3a-4ce8-bf1c-ac810950bc59 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "vcpus": 1, "name": "m1.small"}} {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:33.955620 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-cd88b3c4-fa3a-4ce8-bf1c-ac810950bc59 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.408454 Jul 28 03:52:33.956087 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 13/25] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jul 28 03:52:33 2022] POST /compute/v2.1/flavors => generated 405 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:52:33.968742 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-e70045a9-8158-474b-950f-5759c1149999 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:33.992869 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-e70045a9-8158-474b-950f-5759c1149999 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027387 Jul 28 03:52:33.993524 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 13/26] 10.222.0.46 () {64 vars in 1332 bytes} [Thu Jul 28 03:52:33 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:52:36.171956 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-cd88b3c4-fa3a-4ce8-bf1c-ac810950bc59 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:36.172978 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-cd88b3c4-fa3a-4ce8-bf1c-ac810950bc59 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jul 28 03:52:36.173394 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 14/27] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 03:52:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:36.600043 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-172c43c6-241e-45d9-8230-8adc1a11bb02 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "name": "m1.medium", "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 4096, "id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:36.618635 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-172c43c6-241e-45d9-8230-8adc1a11bb02 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.438671 Jul 28 03:52:36.619214 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 14/28] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jul 28 03:52:36 2022] POST /compute/v2.1/flavors => generated 406 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:52:36.631349 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-4ebf4971-f985-4117-b820-9f18e42f413c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:36.654792 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-4ebf4971-f985-4117-b820-9f18e42f413c admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027031 Jul 28 03:52:36.655374 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 15/29] 10.222.0.46 () {64 vars in 1332 bytes} [Thu Jul 28 03:52:36 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:38.882267 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-172c43c6-241e-45d9-8230-8adc1a11bb02 admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:38.884231 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-172c43c6-241e-45d9-8230-8adc1a11bb02 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002409 Jul 28 03:52:38.884695 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 15/30] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 03:52:38 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:39.346169 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-f795ce23-1e70-4b59-8d69-b64e1cffe74f admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 80, "os-flavor-access:is_public": true, "name": "m1.large", "rxtx_factor": 1.0, "vcpus": 4}} {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:39.366935 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-f795ce23-1e70-4b59-8d69-b64e1cffe74f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.476116 Jul 28 03:52:39.371595 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 16/31] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jul 28 03:52:38 2022] POST /compute/v2.1/flavors => generated 405 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:52:39.380078 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-f4585020-353a-4787-a5e0-e82153b34fb8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:39.409503 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-f4585020-353a-4787-a5e0-e82153b34fb8 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032858 Jul 28 03:52:39.409988 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 16/32] 10.222.0.46 () {64 vars in 1332 bytes} [Thu Jul 28 03:52:39 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:52:41.660089 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-f795ce23-1e70-4b59-8d69-b64e1cffe74f admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:52:41.661974 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-f795ce23-1e70-4b59-8d69-b64e1cffe74f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002296 Jul 28 03:52:41.662386 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 17/33] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 03:52:41 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:52:42.100646 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-abf8cb21-a801-4a5e-aeef-2b85f69e1a3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "5", "name": "m1.xlarge", "vcpus": 8, "os-flavor-access:is_public": true}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:42.125769 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-abf8cb21-a801-4a5e-aeef-2b85f69e1a3f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.456580 Jul 28 03:52:42.126829 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 17/34] 10.222.0.46 () {64 vars in 1282 bytes} [Thu Jul 28 03:52:41 2022] POST /compute/v2.1/flavors => generated 408 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:52:42.138595 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-c828dfb1-d6c8-439d-a9e8-bb52c67c8308 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:52:42.143588 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG dbcounter [-] [103457] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:52:42.169125 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-c828dfb1-d6c8-439d-a9e8-bb52c67c8308 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034158 Jul 28 03:52:42.169730 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 18/35] 10.222.0.46 () {64 vars in 1332 bytes} [Thu Jul 28 03:52:42 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:53:02.396905 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-abf8cb21-a801-4a5e-aeef-2b85f69e1a3f admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:02.397956 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-abf8cb21-a801-4a5e-aeef-2b85f69e1a3f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 Jul 28 03:53:02.398546 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 18/36] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 03:53:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:53:02.785254 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-b9cc094f-2ad8-4bdf-ae00-2b19ad0034b2 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:02.804797 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-b9cc094f-2ad8-4bdf-ae00-2b19ad0034b2 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.398733 Jul 28 03:53:02.805333 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 19/37] 10.222.0.46 () {60 vars in 1291 bytes} [Thu Jul 28 03:53:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:53:03.869388 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-abf8cb21-a801-4a5e-aeef-2b85f69e1a3f admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:03.870410 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-abf8cb21-a801-4a5e-aeef-2b85f69e1a3f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 28 03:53:03.870841 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 19/38] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jul 28 03:53:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:53:04.388638 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-0abaaed2-f8d4-498d-8b82-6861ee13bce7 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:04.394139 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.wsgi [None req-0abaaed2-f8d4-498d-8b82-6861ee13bce7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 03:53:04.397409 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-0abaaed2-f8d4-498d-8b82-6861ee13bce7 admin admin] Request method failure captured: Jul 28 03:53:04.397409 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 03:53:04.397409 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: Accept: application/json Jul 28 03:53:04.397409 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: Accept-Encoding: gzip, deflate Jul 28 03:53:04.397409 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: Connection: keep-alive Jul 28 03:53:04.397409 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: Content-Length: 0 Jul 28 03:53:04.397409 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: Host: 10.222.0.46 Jul 28 03:53:04.397409 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: Openstack-Api-Version: compute 2.90 Jul 28 03:53:04.397409 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: Openstack-System-Scope: None Jul 28 03:53:04.397409 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: User-Agent: python-novaclient Jul 28 03:53:04.397409 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Auth-Token: gAAAAABi4ggfYgrBNQa-q8lEyBUc3m5gY9IeRhD__wofGk7BcVjNJX7Y5K7OxO94y3XLkDZ8ZCpAbYtmXIirY5PhJO_BpDVGYS62kFpHGlMn9P6yzySXypjx2nmHT1S9qhLk7GCfHYjV4LAA11sQQBWgrP-Y1HOrVsXjGxs-RVVjaGwApXOcNUQ Jul 28 03:53:04.397409 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Domain-Id: None Jul 28 03:53:04.397409 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Domain-Name: None Jul 28 03:53:04.397409 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Identity-Status: Confirmed Jul 28 03:53:04.397409 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Is-Admin-Project: True Jul 28 03:53:04.397409 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 03:53:04.397409 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Project-Domain-Id: default Jul 28 03:53:04.397409 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Project-Domain-Name: Default Jul 28 03:53:04.397409 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Project-Id: 826fca2fab6740f6870c6426848e8d90 Jul 28 03:53:04.397409 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Project-Name: admin Jul 28 03:53:04.397409 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Role: admin,reader,member Jul 28 03:53:04.397409 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Roles: admin,reader,member Jul 28 03:53:04.399584 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_826fca2fab6740f6870c6426848e8d90", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/826fca2fab6740f6870c6426848e8d90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/826fca2fab6740f6870c6426848e8d90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/826fca2fab6740f6870c6426848e8d90"}]}] Jul 28 03:53:04.399584 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Tenant: admin Jul 28 03:53:04.399584 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Tenant-Id: 826fca2fab6740f6870c6426848e8d90 Jul 28 03:53:04.399584 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Tenant-Name: admin Jul 28 03:53:04.399584 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-User: admin Jul 28 03:53:04.399584 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-User-Domain-Id: default Jul 28 03:53:04.399584 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-User-Domain-Name: Default Jul 28 03:53:04.399584 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-User-Id: fe2947ccbc264fdba860153b59471d41 Jul 28 03:53:04.399584 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-User-Name: admin Jul 28 03:53:04.399584 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: method: > Jul 28 03:53:04.399584 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: exception: Flavor 42 could not be found. Jul 28 03:53:04.399584 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: action_args: {'id': '42'} Jul 28 03:53:04.399584 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:53:04.399584 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:04.400674 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 03:53:04.400674 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 03:53:04.400674 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 03:53:04.400674 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 03:53:04.400674 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:53:04.400674 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:53:04.400674 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 03:53:04.400674 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 03:53:04.400674 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 03:53:04.400674 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:53:04.400674 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 03:53:04.400674 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 03:53:04.400674 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 03:53:04.400674 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jul 28 03:53:04.400674 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:04.400674 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jul 28 03:53:04.400674 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:04.400674 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:04.400674 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:04.402189 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:53:04.402189 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:53:04.402189 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:53:04.402189 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:53:04.402189 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 03:53:04.402189 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:53:04.402189 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 03:53:04.402189 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jul 28 03:53:04.402189 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:04.402189 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jul 28 03:53:04.402189 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:04.402189 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:04.402189 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:04.402189 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:53:04.402189 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:53:04.402189 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 03:53:04.402189 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jul 28 03:53:04.402189 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-0abaaed2-f8d4-498d-8b82-6861ee13bce7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:53:04.403566 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-0abaaed2-f8d4-498d-8b82-6861ee13bce7 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.391960 Jul 28 03:53:04.403566 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 20/39] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Jul 28 03:53:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:53:04.409038 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-78a5a658-f52f-4c24-9f7c-c24bde529f8e admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:04.414178 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:53:04.434811 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-78a5a658-f52f-4c24-9f7c-c24bde529f8e admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.029330 Jul 28 03:53:04.435381 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 20/40] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Jul 28 03:53:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:04.445038 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-4f153054-b560-4191-b9f4-7d4996d2d08f admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:04.469109 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-4f153054-b560-4191-b9f4-7d4996d2d08f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.027655 Jul 28 03:53:04.469660 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 21/41] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Jul 28 03:53:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:04.480562 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-d3a82c5f-3831-4caf-9fb4-ded39d30981c admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:04.486742 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.wsgi [None req-d3a82c5f-3831-4caf-9fb4-ded39d30981c admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 28 03:53:04.490062 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-d3a82c5f-3831-4caf-9fb4-ded39d30981c admin admin] Request method failure captured: Jul 28 03:53:04.490062 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 28 03:53:04.490062 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: Accept: application/json Jul 28 03:53:04.490062 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: Accept-Encoding: gzip, deflate Jul 28 03:53:04.490062 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: Connection: keep-alive Jul 28 03:53:04.490062 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: Content-Length: 0 Jul 28 03:53:04.490062 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: Host: 10.222.0.46 Jul 28 03:53:04.490062 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: Openstack-Api-Version: compute 2.90 Jul 28 03:53:04.490062 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: Openstack-System-Scope: None Jul 28 03:53:04.490062 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: User-Agent: python-novaclient Jul 28 03:53:04.490062 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Auth-Token: gAAAAABi4ggfYgrBNQa-q8lEyBUc3m5gY9IeRhD__wofGk7BcVjNJX7Y5K7OxO94y3XLkDZ8ZCpAbYtmXIirY5PhJO_BpDVGYS62kFpHGlMn9P6yzySXypjx2nmHT1S9qhLk7GCfHYjV4LAA11sQQBWgrP-Y1HOrVsXjGxs-RVVjaGwApXOcNUQ Jul 28 03:53:04.490062 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Domain-Id: None Jul 28 03:53:04.490062 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Domain-Name: None Jul 28 03:53:04.490062 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Identity-Status: Confirmed Jul 28 03:53:04.490062 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Is-Admin-Project: True Jul 28 03:53:04.490062 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 03:53:04.490062 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Project-Domain-Id: default Jul 28 03:53:04.490062 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Project-Domain-Name: Default Jul 28 03:53:04.490062 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Project-Id: 826fca2fab6740f6870c6426848e8d90 Jul 28 03:53:04.490062 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Project-Name: admin Jul 28 03:53:04.490062 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Role: admin,reader,member Jul 28 03:53:04.490062 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Roles: admin,reader,member Jul 28 03:53:04.491665 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_826fca2fab6740f6870c6426848e8d90", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/826fca2fab6740f6870c6426848e8d90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/826fca2fab6740f6870c6426848e8d90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/826fca2fab6740f6870c6426848e8d90"}]}] Jul 28 03:53:04.491665 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Tenant: admin Jul 28 03:53:04.491665 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Tenant-Id: 826fca2fab6740f6870c6426848e8d90 Jul 28 03:53:04.491665 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Tenant-Name: admin Jul 28 03:53:04.491665 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-User: admin Jul 28 03:53:04.491665 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-User-Domain-Id: default Jul 28 03:53:04.491665 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-User-Domain-Name: Default Jul 28 03:53:04.491665 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-User-Id: fe2947ccbc264fdba860153b59471d41 Jul 28 03:53:04.491665 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-User-Name: admin Jul 28 03:53:04.491665 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: method: > Jul 28 03:53:04.491665 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: exception: Flavor 42 could not be found. Jul 28 03:53:04.491665 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: action_args: {'id': '42'} Jul 28 03:53:04.491665 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:53:04.491665 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:04.493968 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 03:53:04.493968 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 03:53:04.493968 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 03:53:04.493968 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 03:53:04.493968 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:53:04.493968 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:53:04.493968 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 03:53:04.493968 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 03:53:04.493968 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 03:53:04.493968 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:53:04.493968 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 03:53:04.493968 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 03:53:04.493968 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 28 03:53:04.493968 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jul 28 03:53:04.493968 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:04.493968 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jul 28 03:53:04.493968 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:04.493968 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:04.493968 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:04.495334 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:53:04.495334 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:53:04.495334 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:53:04.495334 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:53:04.495334 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 03:53:04.495334 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:53:04.495334 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 28 03:53:04.495334 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jul 28 03:53:04.495334 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:04.495334 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jul 28 03:53:04.495334 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:04.495334 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:04.495334 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:04.495334 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:53:04.495334 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:53:04.495334 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 28 03:53:04.495334 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jul 28 03:53:04.495334 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-d3a82c5f-3831-4caf-9fb4-ded39d30981c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:53:04.496561 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-d3a82c5f-3831-4caf-9fb4-ded39d30981c admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016170 Jul 28 03:53:04.496561 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 21/42] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Jul 28 03:53:04 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 28 03:53:05.479403 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-4f153054-b560-4191-b9f4-7d4996d2d08f admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:05.480413 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-4f153054-b560-4191-b9f4-7d4996d2d08f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 28 03:53:05.480810 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 22/43] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jul 28 03:53:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:53:06.005330 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-e91c0b67-eb1b-4735-ab85-e586c5189c70 admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:06.010999 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.wsgi [None req-e91c0b67-eb1b-4735-ab85-e586c5189c70 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 03:53:06.012502 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-e91c0b67-eb1b-4735-ab85-e586c5189c70 admin admin] Request method failure captured: Jul 28 03:53:06.012502 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 03:53:06.012502 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: Accept: application/json Jul 28 03:53:06.012502 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: Accept-Encoding: gzip, deflate Jul 28 03:53:06.012502 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: Connection: keep-alive Jul 28 03:53:06.012502 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: Content-Length: 0 Jul 28 03:53:06.012502 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: Host: 10.222.0.46 Jul 28 03:53:06.012502 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: Openstack-Api-Version: compute 2.90 Jul 28 03:53:06.012502 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: Openstack-System-Scope: None Jul 28 03:53:06.012502 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: User-Agent: python-novaclient Jul 28 03:53:06.012502 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Auth-Token: gAAAAABi4gghhcalvthyDTlIrbrBJcSY4dT3GLLgft-fZDGQOh3waOARACYD9mkFXtH5KPkU79ezpd1FFhA7Z9PXSRDeR2e5alNveLKG8h3X9DVt6m6cAcpGwJsXHaqCq0oYo5zqJ-ycZhgZQVAEDhnLMxb8nQucLQnRjkCeBb6BUPWDnTSsQJw Jul 28 03:53:06.012502 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Domain-Id: None Jul 28 03:53:06.012502 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Domain-Name: None Jul 28 03:53:06.012502 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Identity-Status: Confirmed Jul 28 03:53:06.012502 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Is-Admin-Project: True Jul 28 03:53:06.012502 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 03:53:06.012502 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Project-Domain-Id: default Jul 28 03:53:06.012502 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Project-Domain-Name: Default Jul 28 03:53:06.012502 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Project-Id: 826fca2fab6740f6870c6426848e8d90 Jul 28 03:53:06.012502 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Project-Name: admin Jul 28 03:53:06.012502 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Role: admin,reader,member Jul 28 03:53:06.012502 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Roles: admin,reader,member Jul 28 03:53:06.013973 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_826fca2fab6740f6870c6426848e8d90", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/826fca2fab6740f6870c6426848e8d90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/826fca2fab6740f6870c6426848e8d90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/826fca2fab6740f6870c6426848e8d90"}]}] Jul 28 03:53:06.013973 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Tenant: admin Jul 28 03:53:06.013973 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Tenant-Id: 826fca2fab6740f6870c6426848e8d90 Jul 28 03:53:06.013973 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Tenant-Name: admin Jul 28 03:53:06.013973 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-User: admin Jul 28 03:53:06.013973 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-User-Domain-Id: default Jul 28 03:53:06.013973 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-User-Domain-Name: Default Jul 28 03:53:06.013973 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-User-Id: fe2947ccbc264fdba860153b59471d41 Jul 28 03:53:06.013973 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-User-Name: admin Jul 28 03:53:06.013973 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: method: > Jul 28 03:53:06.013973 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: exception: Flavor 84 could not be found. Jul 28 03:53:06.013973 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: action_args: {'id': '84'} Jul 28 03:53:06.013973 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:53:06.013973 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:06.014945 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 03:53:06.014945 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 03:53:06.014945 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 03:53:06.014945 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 03:53:06.014945 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:53:06.014945 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:53:06.014945 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 03:53:06.014945 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 03:53:06.014945 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 03:53:06.014945 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:53:06.014945 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 03:53:06.014945 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 03:53:06.014945 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 03:53:06.014945 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jul 28 03:53:06.014945 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:06.014945 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jul 28 03:53:06.014945 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:06.014945 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:06.014945 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:06.016381 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:53:06.016381 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:53:06.016381 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:53:06.016381 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:53:06.016381 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 03:53:06.016381 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:53:06.016381 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 03:53:06.016381 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jul 28 03:53:06.016381 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:06.016381 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jul 28 03:53:06.016381 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:06.016381 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:06.016381 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:06.016381 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:53:06.016381 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:53:06.016381 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 03:53:06.016381 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jul 28 03:53:06.016381 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-e91c0b67-eb1b-4735-ab85-e586c5189c70 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:53:06.017596 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-e91c0b67-eb1b-4735-ab85-e586c5189c70 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.391653 Jul 28 03:53:06.017596 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 22/44] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Jul 28 03:53:05 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:53:06.024217 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-d1879f6d-8772-4448-a867-2b14be9fc16d admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:06.039977 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-d1879f6d-8772-4448-a867-2b14be9fc16d admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019896 Jul 28 03:53:06.040508 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 23/45] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Jul 28 03:53:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:06.049842 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-d18b63b6-77b4-49f0-897e-dd240dcee550 admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:06.064863 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-d18b63b6-77b4-49f0-897e-dd240dcee550 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018527 Jul 28 03:53:06.065394 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 23/46] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Jul 28 03:53:06 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:53:06.074569 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-e86a467d-7d1d-4a97-9282-9256437d9112 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:06.079832 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.wsgi [None req-e86a467d-7d1d-4a97-9282-9256437d9112 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 28 03:53:06.081343 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-e86a467d-7d1d-4a97-9282-9256437d9112 admin admin] Request method failure captured: Jul 28 03:53:06.081343 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 28 03:53:06.081343 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: Accept: application/json Jul 28 03:53:06.081343 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: Accept-Encoding: gzip, deflate Jul 28 03:53:06.081343 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: Connection: keep-alive Jul 28 03:53:06.081343 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: Content-Length: 0 Jul 28 03:53:06.081343 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: Host: 10.222.0.46 Jul 28 03:53:06.081343 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: Openstack-Api-Version: compute 2.90 Jul 28 03:53:06.081343 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: Openstack-System-Scope: None Jul 28 03:53:06.081343 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: User-Agent: python-novaclient Jul 28 03:53:06.081343 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Auth-Token: gAAAAABi4gghhcalvthyDTlIrbrBJcSY4dT3GLLgft-fZDGQOh3waOARACYD9mkFXtH5KPkU79ezpd1FFhA7Z9PXSRDeR2e5alNveLKG8h3X9DVt6m6cAcpGwJsXHaqCq0oYo5zqJ-ycZhgZQVAEDhnLMxb8nQucLQnRjkCeBb6BUPWDnTSsQJw Jul 28 03:53:06.081343 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Domain-Id: None Jul 28 03:53:06.081343 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Domain-Name: None Jul 28 03:53:06.081343 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Identity-Status: Confirmed Jul 28 03:53:06.081343 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Is-Admin-Project: True Jul 28 03:53:06.081343 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 03:53:06.081343 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Project-Domain-Id: default Jul 28 03:53:06.081343 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Project-Domain-Name: Default Jul 28 03:53:06.081343 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Project-Id: 826fca2fab6740f6870c6426848e8d90 Jul 28 03:53:06.081343 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Project-Name: admin Jul 28 03:53:06.081343 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Role: admin,reader,member Jul 28 03:53:06.081343 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Roles: admin,reader,member Jul 28 03:53:06.082898 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_826fca2fab6740f6870c6426848e8d90", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/826fca2fab6740f6870c6426848e8d90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/826fca2fab6740f6870c6426848e8d90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/826fca2fab6740f6870c6426848e8d90"}]}] Jul 28 03:53:06.082898 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Tenant: admin Jul 28 03:53:06.082898 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Tenant-Id: 826fca2fab6740f6870c6426848e8d90 Jul 28 03:53:06.082898 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Tenant-Name: admin Jul 28 03:53:06.082898 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-User: admin Jul 28 03:53:06.082898 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-User-Domain-Id: default Jul 28 03:53:06.082898 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-User-Domain-Name: Default Jul 28 03:53:06.082898 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-User-Id: fe2947ccbc264fdba860153b59471d41 Jul 28 03:53:06.082898 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-User-Name: admin Jul 28 03:53:06.082898 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: method: > Jul 28 03:53:06.082898 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: exception: Flavor 84 could not be found. Jul 28 03:53:06.082898 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: action_args: {'id': '84'} Jul 28 03:53:06.082898 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:53:06.082898 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:06.083850 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 03:53:06.083850 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 03:53:06.083850 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 03:53:06.083850 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 03:53:06.083850 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:53:06.083850 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:53:06.083850 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 03:53:06.083850 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 03:53:06.083850 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 03:53:06.083850 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:53:06.083850 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 03:53:06.083850 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 03:53:06.083850 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 28 03:53:06.083850 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jul 28 03:53:06.083850 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:06.083850 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jul 28 03:53:06.083850 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:06.083850 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:06.083850 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:06.085664 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:53:06.085664 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:53:06.085664 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:53:06.085664 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:53:06.085664 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 03:53:06.085664 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:53:06.085664 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 28 03:53:06.085664 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jul 28 03:53:06.085664 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:06.085664 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jul 28 03:53:06.085664 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:06.085664 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:06.085664 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:06.085664 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:53:06.085664 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:53:06.085664 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 28 03:53:06.085664 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jul 28 03:53:06.085664 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-e86a467d-7d1d-4a97-9282-9256437d9112 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:53:06.086994 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-e86a467d-7d1d-4a97-9282-9256437d9112 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011680 Jul 28 03:53:06.086994 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 24/47] 10.222.0.46 () {60 vars in 1190 bytes} [Thu Jul 28 03:53:06 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:53:07.069334 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-d18b63b6-77b4-49f0-897e-dd240dcee550 admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:07.070447 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-d18b63b6-77b4-49f0-897e-dd240dcee550 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Jul 28 03:53:07.070860 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 24/48] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jul 28 03:53:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:53:07.600782 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-e462f283-4018-4761-9c08-edbe1de60759 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:07.607586 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.wsgi [None req-e462f283-4018-4761-9c08-edbe1de60759 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 03:53:07.609082 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-e462f283-4018-4761-9c08-edbe1de60759 admin admin] Request method failure captured: Jul 28 03:53:07.609082 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 03:53:07.609082 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: Accept: application/json Jul 28 03:53:07.609082 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: Accept-Encoding: gzip, deflate Jul 28 03:53:07.609082 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: Connection: keep-alive Jul 28 03:53:07.609082 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: Content-Length: 0 Jul 28 03:53:07.609082 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: Host: 10.222.0.46 Jul 28 03:53:07.609082 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: Openstack-Api-Version: compute 2.90 Jul 28 03:53:07.609082 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: Openstack-System-Scope: None Jul 28 03:53:07.609082 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: User-Agent: python-novaclient Jul 28 03:53:07.609082 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Auth-Token: gAAAAABi4ggiY5q4NyLM6xcgsygFC4DcNLXVnj2MVvj0bIZ8Ms0tgTZDmH241uAhxBbl_nzQegMv_MqSvHna3oQ_6OurSRTGX7aL2HfTpC0Ir6QeOAGwtJxGqVcHibzO6WosB0EtXhAyujvLOpXw6wkwcyZ8R-q_da1BO4t_aLA6UoQPPu-4yAE Jul 28 03:53:07.609082 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Domain-Id: None Jul 28 03:53:07.609082 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Domain-Name: None Jul 28 03:53:07.609082 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Identity-Status: Confirmed Jul 28 03:53:07.609082 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Is-Admin-Project: True Jul 28 03:53:07.609082 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 03:53:07.609082 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Project-Domain-Id: default Jul 28 03:53:07.609082 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Project-Domain-Name: Default Jul 28 03:53:07.609082 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Project-Id: 826fca2fab6740f6870c6426848e8d90 Jul 28 03:53:07.609082 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Project-Name: admin Jul 28 03:53:07.609082 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Role: admin,reader,member Jul 28 03:53:07.609082 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Roles: admin,reader,member Jul 28 03:53:07.610745 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_826fca2fab6740f6870c6426848e8d90", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/826fca2fab6740f6870c6426848e8d90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/826fca2fab6740f6870c6426848e8d90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/826fca2fab6740f6870c6426848e8d90"}]}] Jul 28 03:53:07.610745 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Tenant: admin Jul 28 03:53:07.610745 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Tenant-Id: 826fca2fab6740f6870c6426848e8d90 Jul 28 03:53:07.610745 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-Tenant-Name: admin Jul 28 03:53:07.610745 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-User: admin Jul 28 03:53:07.610745 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-User-Domain-Id: default Jul 28 03:53:07.610745 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-User-Domain-Name: Default Jul 28 03:53:07.610745 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-User-Id: fe2947ccbc264fdba860153b59471d41 Jul 28 03:53:07.610745 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: X-User-Name: admin Jul 28 03:53:07.610745 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: method: > Jul 28 03:53:07.610745 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: exception: Flavor 451 could not be found. Jul 28 03:53:07.610745 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: action_args: {'id': '451'} Jul 28 03:53:07.610745 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:53:07.610745 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:07.611752 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 03:53:07.611752 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 03:53:07.611752 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 03:53:07.611752 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 03:53:07.611752 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:53:07.611752 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:53:07.611752 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 03:53:07.611752 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 03:53:07.611752 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 03:53:07.611752 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:53:07.611752 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 03:53:07.611752 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 03:53:07.611752 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 03:53:07.611752 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jul 28 03:53:07.611752 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:07.611752 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jul 28 03:53:07.611752 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:07.611752 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:07.611752 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:07.613085 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:53:07.613085 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:53:07.613085 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:53:07.613085 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:53:07.613085 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 03:53:07.613085 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:53:07.613085 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 03:53:07.613085 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jul 28 03:53:07.613085 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:07.613085 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jul 28 03:53:07.613085 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:07.613085 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:07.613085 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:07.613085 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:53:07.613085 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:53:07.613085 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 03:53:07.613085 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: ERROR nova.api.openstack.wsgi Jul 28 03:53:07.613085 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-e462f283-4018-4761-9c08-edbe1de60759 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103457) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:53:07.614363 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-e462f283-4018-4761-9c08-edbe1de60759 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.402569 Jul 28 03:53:07.614363 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 25/49] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Jul 28 03:53:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:53:07.620558 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-7d8f4a52-f168-48ed-8342-f11fa9d285ff admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:07.635786 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-7d8f4a52-f168-48ed-8342-f11fa9d285ff admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019340 Jul 28 03:53:07.636310 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 25/50] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Jul 28 03:53:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:53:07.645603 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-c7da5c7e-f259-4861-9307-e8e293876a83 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:07.660251 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-c7da5c7e-f259-4861-9307-e8e293876a83 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018195 Jul 28 03:53:07.660766 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 26/51] 10.222.0.46 () {60 vars in 1210 bytes} [Thu Jul 28 03:53:07 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 03:53:07.670251 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-d5b38937-d62e-45bf-92a4-5f421681b560 admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:07.675486 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.wsgi [None req-d5b38937-d62e-45bf-92a4-5f421681b560 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 28 03:53:07.676959 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-d5b38937-d62e-45bf-92a4-5f421681b560 admin admin] Request method failure captured: Jul 28 03:53:07.676959 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 28 03:53:07.676959 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: Accept: application/json Jul 28 03:53:07.676959 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: Accept-Encoding: gzip, deflate Jul 28 03:53:07.676959 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: Connection: keep-alive Jul 28 03:53:07.676959 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: Content-Length: 0 Jul 28 03:53:07.676959 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: Host: 10.222.0.46 Jul 28 03:53:07.676959 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: Openstack-Api-Version: compute 2.90 Jul 28 03:53:07.676959 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: Openstack-System-Scope: None Jul 28 03:53:07.676959 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: User-Agent: python-novaclient Jul 28 03:53:07.676959 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Auth-Token: gAAAAABi4ggiY5q4NyLM6xcgsygFC4DcNLXVnj2MVvj0bIZ8Ms0tgTZDmH241uAhxBbl_nzQegMv_MqSvHna3oQ_6OurSRTGX7aL2HfTpC0Ir6QeOAGwtJxGqVcHibzO6WosB0EtXhAyujvLOpXw6wkwcyZ8R-q_da1BO4t_aLA6UoQPPu-4yAE Jul 28 03:53:07.676959 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Domain-Id: None Jul 28 03:53:07.676959 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Domain-Name: None Jul 28 03:53:07.676959 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Identity-Status: Confirmed Jul 28 03:53:07.676959 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Is-Admin-Project: True Jul 28 03:53:07.676959 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Openstack-Nova-Api-Version: 2.90 Jul 28 03:53:07.676959 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Project-Domain-Id: default Jul 28 03:53:07.676959 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Project-Domain-Name: Default Jul 28 03:53:07.676959 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Project-Id: 826fca2fab6740f6870c6426848e8d90 Jul 28 03:53:07.676959 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Project-Name: admin Jul 28 03:53:07.676959 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Role: admin,reader,member Jul 28 03:53:07.676959 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Roles: admin,reader,member Jul 28 03:53:07.678438 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_826fca2fab6740f6870c6426848e8d90", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/826fca2fab6740f6870c6426848e8d90"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/826fca2fab6740f6870c6426848e8d90"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/826fca2fab6740f6870c6426848e8d90"}]}] Jul 28 03:53:07.678438 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Tenant: admin Jul 28 03:53:07.678438 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Tenant-Id: 826fca2fab6740f6870c6426848e8d90 Jul 28 03:53:07.678438 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-Tenant-Name: admin Jul 28 03:53:07.678438 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-User: admin Jul 28 03:53:07.678438 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-User-Domain-Id: default Jul 28 03:53:07.678438 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-User-Domain-Name: Default Jul 28 03:53:07.678438 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-User-Id: fe2947ccbc264fdba860153b59471d41 Jul 28 03:53:07.678438 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: X-User-Name: admin Jul 28 03:53:07.678438 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: method: > Jul 28 03:53:07.678438 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: exception: Flavor 451 could not be found. Jul 28 03:53:07.678438 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: action_args: {'id': '451'} Jul 28 03:53:07.678438 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:53:07.678438 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:07.680237 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 28 03:53:07.680237 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 28 03:53:07.680237 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 28 03:53:07.680237 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 28 03:53:07.680237 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 03:53:07.680237 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 03:53:07.680237 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 28 03:53:07.680237 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 28 03:53:07.680237 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 28 03:53:07.680237 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:53:07.680237 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 28 03:53:07.680237 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 28 03:53:07.680237 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 28 03:53:07.680237 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jul 28 03:53:07.680237 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:07.680237 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jul 28 03:53:07.680237 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:07.680237 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:07.680237 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:07.681562 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:53:07.681562 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:53:07.681562 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:53:07.681562 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:53:07.681562 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 28 03:53:07.681562 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:53:07.681562 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 28 03:53:07.681562 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jul 28 03:53:07.681562 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:53:07.681562 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jul 28 03:53:07.681562 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:53:07.681562 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:53:07.681562 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:53:07.681562 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:53:07.681562 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:53:07.681562 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 28 03:53:07.681562 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: ERROR nova.api.openstack.wsgi Jul 28 03:53:07.681562 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-d5b38937-d62e-45bf-92a4-5f421681b560 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103456) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:53:07.682848 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-d5b38937-d62e-45bf-92a4-5f421681b560 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011476 Jul 28 03:53:07.682848 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 26/52] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Jul 28 03:53:07 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 28 03:53:08.660141 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-c7da5c7e-f259-4861-9307-e8e293876a83 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:08.661140 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-c7da5c7e-f259-4861-9307-e8e293876a83 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 28 03:53:08.661532 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 27/53] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jul 28 03:53:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:53:09.183392 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-2493da2d-2dcf-4b93-b2be-80bd395b8cf6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:09.201772 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-2493da2d-2dcf-4b93-b2be-80bd395b8cf6 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.402286 Jul 28 03:53:09.202318 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 27/54] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Jul 28 03:53:08 2022] POST /compute/v2.1/flavors => generated 404 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 03:53:10.173564 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-c7da5c7e-f259-4861-9307-e8e293876a83 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:10.174576 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-c7da5c7e-f259-4861-9307-e8e293876a83 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jul 28 03:53:10.175020 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 28/55] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jul 28 03:53:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:53:10.708714 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-de089e38-1dc8-4349-81e4-601515b9331f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:10.728663 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-de089e38-1dc8-4349-81e4-601515b9331f admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.412905 Jul 28 03:53:10.729220 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 28/56] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Jul 28 03:53:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:53:11.696922 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-c7da5c7e-f259-4861-9307-e8e293876a83 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:11.697922 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-c7da5c7e-f259-4861-9307-e8e293876a83 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Jul 28 03:53:11.698324 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 29/57] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jul 28 03:53:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:53:12.217949 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-da16b0c3-3c43-400d-8190-e699dbf20921 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:12.237442 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-da16b0c3-3c43-400d-8190-e699dbf20921 admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.402225 Jul 28 03:53:12.237974 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 29/58] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Jul 28 03:53:11 2022] POST /compute/v2.1/flavors => generated 407 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:53:13.225481 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-c7da5c7e-f259-4861-9307-e8e293876a83 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:13.227066 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-c7da5c7e-f259-4861-9307-e8e293876a83 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002004 Jul 28 03:53:13.227466 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 30/59] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jul 28 03:53:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:53:13.742161 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-60bc9355-5efe-480d-9fd7-67b267598cff admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:53:13.760845 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-60bc9355-5efe-480d-9fd7-67b267598cff admin admin] 10.222.0.46 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.395145 Jul 28 03:53:13.761394 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 30/60] 10.222.0.46 () {64 vars in 1235 bytes} [Thu Jul 28 03:53:13 2022] POST /compute/v2.1/flavors => generated 409 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:53:14.729505 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-c7da5c7e-f259-4861-9307-e8e293876a83 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:14.730513 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-c7da5c7e-f259-4861-9307-e8e293876a83 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jul 28 03:53:14.730939 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 31/61] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jul 28 03:53:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:53:15.302637 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-1a4e490c-8b38-4bd7-9423-029e3e3d065d admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:53:15.324479 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-1a4e490c-8b38-4bd7-9423-029e3e3d065d admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.455567 Jul 28 03:53:15.325043 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 31/62] 10.222.0.46 () {60 vars in 1202 bytes} [Thu Jul 28 03:53:14 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:06.835944 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-c7da5c7e-f259-4861-9307-e8e293876a83 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:06.836981 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-c7da5c7e-f259-4861-9307-e8e293876a83 admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 28 03:54:06.837379 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 32/63] 10.222.0.46 () {54 vars in 930 bytes} [Thu Jul 28 03:54:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:54:06.847754 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:07.230317 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-89fc5dc6-84df-4e7f-8985-a2ca0f15bdcb admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:07.251053 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-89fc5dc6-84df-4e7f-8985-a2ca0f15bdcb admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.407728 Jul 28 03:54:07.251600 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 32/64] 10.222.0.46 () {60 vars in 1291 bytes} [Thu Jul 28 03:54:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:54:07.276005 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-dde453fe-2a9b-437a-964d-769256798a78 admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:07.279403 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG dbcounter [-] [103457] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=103457) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:54:07.285032 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-dde453fe-2a9b-437a-964d-769256798a78 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012706 Jul 28 03:54:07.285558 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 33/65] 10.222.0.46 () {60 vars in 1282 bytes} [Thu Jul 28 03:54:07 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:07.297989 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-49c42a36-d267-400b-9b46-df8d3cd7b5d2 admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:07.306484 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-49c42a36-d267-400b-9b46-df8d3cd7b5d2 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012072 Jul 28 03:54:07.307049 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 33/66] 10.222.0.46 () {60 vars in 1285 bytes} [Thu Jul 28 03:54:07 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:54:07.318569 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-984f9cd8-5674-4937-979b-216f4aa5f36f admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:07.326445 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-984f9cd8-5674-4937-979b-216f4aa5f36f admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011793 Jul 28 03:54:07.326942 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 34/67] 10.222.0.46 () {60 vars in 1285 bytes} [Thu Jul 28 03:54:07 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:54:07.338308 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-3c3ea56e-6560-48c7-9162-b9ce3692bca9 admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:54:07.345953 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-3c3ea56e-6560-48c7-9162-b9ce3692bca9 admin admin] 10.222.0.46 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011300 Jul 28 03:54:07.346454 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 34/68] 10.222.0.46 () {60 vars in 1282 bytes} [Thu Jul 28 03:54:07 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:57:27.835430 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-984f9cd8-5674-4937-979b-216f4aa5f36f admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:27.836442 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-984f9cd8-5674-4937-979b-216f4aa5f36f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001476 Jul 28 03:57:27.836839 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 35/69] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jul 28 03:57:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:57:27.980695 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writing DB stats nova_api:SELECT=6 {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:57:28.139739 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-2a0a9bd7-9ce2-41c6-bbdf-dbc53fa03c73 admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:28.142224 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:57:28.142224 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: warnings.warn(msg) Jul 28 03:57:28.144072 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-2a0a9bd7-9ce2-41c6-bbdf-dbc53fa03c73 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:28.144547 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-2a0a9bd7-9ce2-41c6-bbdf-dbc53fa03c73 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:28.145329 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-2a0a9bd7-9ce2-41c6-bbdf-dbc53fa03c73 admin admin] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:28.145760 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-2a0a9bd7-9ce2-41c6-bbdf-dbc53fa03c73 admin admin] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:28.181183 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-2a0a9bd7-9ce2-41c6-bbdf-dbc53fa03c73 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.201937 Jul 28 03:57:28.181759 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 35/70] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Jul 28 03:57:27 2022] GET /compute/v2.1/os-services => generated 794 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:57:29.026921 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-984f9cd8-5674-4937-979b-216f4aa5f36f admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:29.027926 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-984f9cd8-5674-4937-979b-216f4aa5f36f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 28 03:57:29.028329 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 36/71] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jul 28 03:57:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:57:29.225214 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-660d1dbe-e426-4cc3-b52c-57c17ea9a3ae admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:29.227839 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:57:29.227839 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: warnings.warn(msg) Jul 28 03:57:29.229050 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-660d1dbe-e426-4cc3-b52c-57c17ea9a3ae admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:29.229653 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-660d1dbe-e426-4cc3-b52c-57c17ea9a3ae admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:29.230473 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-660d1dbe-e426-4cc3-b52c-57c17ea9a3ae admin admin] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:29.230931 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-660d1dbe-e426-4cc3-b52c-57c17ea9a3ae admin admin] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:29.250930 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-660d1dbe-e426-4cc3-b52c-57c17ea9a3ae admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.082535 Jul 28 03:57:29.251429 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 36/72] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Jul 28 03:57:29 2022] GET /compute/v2.1/os-services => generated 794 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 03:57:40.500596 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-984f9cd8-5674-4937-979b-216f4aa5f36f admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:40.502411 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-984f9cd8-5674-4937-979b-216f4aa5f36f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002214 Jul 28 03:57:40.502838 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 37/73] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jul 28 03:57:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:57:40.652762 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writing DB stats nova_cell0:SELECT=4 {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:57:40.653764 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writing DB stats nova_cell1:SELECT=4 {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:57:40.654369 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG dbcounter [-] [103456] Writing DB stats nova_api:SELECT=8 {{(pid=103456) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:57:40.702966 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-c43a5491-61b1-4475-a50a-7c6c9147b6a7 admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:40.705549 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:57:40.705549 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: warnings.warn(msg) Jul 28 03:57:40.706733 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-c43a5491-61b1-4475-a50a-7c6c9147b6a7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:40.707201 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-c43a5491-61b1-4475-a50a-7c6c9147b6a7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:40.707984 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-c43a5491-61b1-4475-a50a-7c6c9147b6a7 admin admin] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:40.708419 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-c43a5491-61b1-4475-a50a-7c6c9147b6a7 admin admin] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:40.733194 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-c43a5491-61b1-4475-a50a-7c6c9147b6a7 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.088863 Jul 28 03:57:40.733686 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 37/74] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Jul 28 03:57:40 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:57:41.558358 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: DEBUG nova.api.openstack.wsgi [None req-984f9cd8-5674-4937-979b-216f4aa5f36f admin admin] Calling method '>' {{(pid=103457) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:41.559409 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: INFO nova.api.openstack.requestlog [None req-984f9cd8-5674-4937-979b-216f4aa5f36f admin admin] 10.222.0.46 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 28 03:57:41.559808 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: [pid: 103457|app: 0|req: 38/75] 10.222.0.46 () {56 vars in 1074 bytes} [Thu Jul 28 03:57:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:57:41.757600 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG nova.api.openstack.wsgi [None req-21300c00-44d2-4356-9ef9-3f6d5e52c588 admin admin] Calling method '>' {{(pid=103456) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:57:41.760093 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 28 03:57:41.760093 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: warnings.warn(msg) Jul 28 03:57:41.761290 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-21300c00-44d2-4356-9ef9-3f6d5e52c588 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:41.761729 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-21300c00-44d2-4356-9ef9-3f6d5e52c588 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:41.762533 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-21300c00-44d2-4356-9ef9-3f6d5e52c588 admin admin] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:57:41.763001 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: DEBUG oslo_concurrency.lockutils [None req-21300c00-44d2-4356-9ef9-3f6d5e52c588 admin admin] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103456) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:57:41.785483 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: INFO nova.api.openstack.requestlog [None req-21300c00-44d2-4356-9ef9-3f6d5e52c588 admin admin] 10.222.0.46 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.082806 Jul 28 03:57:41.785961 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: [pid: 103456|app: 0|req: 38/76] 10.222.0.46 () {60 vars in 1193 bytes} [Thu Jul 28 03:57:41 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 03:58:37.610184 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: Thu Jul 28 03:58:37 2022 - graceful shutdown triggered... Jul 28 03:58:37.610707 dv-cinder-799871-47-iscsi devstack@n-api.service[103456]: Gracefully killing worker 1 (pid: 103456)... Jul 28 03:58:37.611115 dv-cinder-799871-47-iscsi devstack@n-api.service[103457]: Gracefully killing worker 2 (pid: 103457)... Jul 28 03:58:37.615763 dv-cinder-799871-47-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 28 03:58:38.611152 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: worker 1 buried after 1 seconds Jul 28 03:58:38.611636 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: worker 2 buried after 1 seconds Jul 28 03:58:38.611636 dv-cinder-799871-47-iscsi devstack@n-api.service[103455]: goodbye to uWSGI. Jul 28 03:58:38.612782 dv-cinder-799871-47-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 28 03:58:38.613851 dv-cinder-799871-47-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 28 03:58:38.616770 dv-cinder-799871-47-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 28 03:58:38.626173 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 28 03:58:38.628197 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 28 03:58:38 2022] *** Jul 28 03:58:38.628197 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 28 03:58:38.628197 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 28 03:58:38.628197 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: nodename: dv-cinder-799871-47-iscsi Jul 28 03:58:38.628197 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: machine: x86_64 Jul 28 03:58:38.628197 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: clock source: unix Jul 28 03:58:38.628197 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: pcre jit disabled Jul 28 03:58:38.628197 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: detected number of CPU cores: 4 Jul 28 03:58:38.628197 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: current working directory: / Jul 28 03:58:38.628197 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: detected binary path: /usr/bin/uwsgi-core Jul 28 03:58:38.628880 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: your processes number limit is 47680 Jul 28 03:58:38.628880 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: your memory page size is 4096 bytes Jul 28 03:58:38.628880 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: detected max file descriptor number: 2048 Jul 28 03:58:38.628880 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: lock engine: pthread robust mutexes Jul 28 03:58:38.628880 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: thunder lock: enabled Jul 28 03:58:38.628880 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 28 03:58:38.628880 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 28 03:58:38.669965 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: Python main interpreter initialized at 0x5626ead6a9c0 Jul 28 03:58:38.669965 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: python threads support enabled Jul 28 03:58:38.669965 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: your server socket listen backlog is limited to 100 connections Jul 28 03:58:38.669965 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: your mercy for graceful operations on workers is 90 seconds Jul 28 03:58:38.670335 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: mapped 403077 bytes (393 KB) for 2 cores Jul 28 03:58:38.670411 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: *** Operational MODE: preforking *** Jul 28 03:58:38.670676 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: *** uWSGI is running in multiple interpreter mode *** Jul 28 03:58:38.670676 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: spawned uWSGI master process (pid: 118171) Jul 28 03:58:38.674295 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: spawned uWSGI worker 1 (pid: 118186, cores: 1) Jul 28 03:58:38.674295 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: spawned uWSGI worker 2 (pid: 118187, cores: 1) Jul 28 03:58:38.674295 dv-cinder-799871-47-iscsi devstack@n-api.service[118171]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 28 03:58:38.670888 dv-cinder-799871-47-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 28 03:58:39.341755 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 03:58:39.354792 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 28 03:58:40.534893 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:58:40.534893 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: from cryptography.utils import int_from_bytes Jul 28 03:58:40.534893 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:58:40.534893 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: from cryptography.utils import int_from_bytes Jul 28 03:58:40.553709 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:58:40.553709 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: from cryptography.utils import int_from_bytes Jul 28 03:58:40.554264 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 28 03:58:40.554264 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: from cryptography.utils import int_from_bytes Jul 28 03:58:42.983241 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 03:58:42.983826 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 03:58:42.984130 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 03:58:42.984429 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 03:58:42.984666 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 03:58:42.985070 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.985401 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.985724 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.986045 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.986386 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.986700 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.987118 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.987451 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.987783 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.988047 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.988912 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.989245 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-47-iscsi {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.989575 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.990065 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.990382 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.990710 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.991047 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.991378 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.991702 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.992212 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.993639 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.993639 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.993639 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.993920 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.994245 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.994552 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.994907 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.995498 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.995843 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.996148 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.996572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-47-iscsi {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.996897 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.997214 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.997533 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.997964 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.998281 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.998587 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.998936 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.999265 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.999577 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:42.999908 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.000223 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.000548 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.000871 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.001177 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.001492 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.001793 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.002114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.002420 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.002726 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.003007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.003315 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.003640 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.004579 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.004911 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.005357 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.005635 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.005962 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.006289 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.006605 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.006949 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.007266 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.007576 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.007881 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.008189 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.008497 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.008806 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.009132 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.009451 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.009779 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.010087 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.010410 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.010859 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.011419 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.011746 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.012083 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.012411 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.012726 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.013047 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.013373 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.013683 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.013990 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.014311 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.015739 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.016100 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.016425 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.016691 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.017012 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.017329 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.017685 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.018371 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.018693 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.019034 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.019343 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.019702 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.020215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.020569 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.020882 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.021157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.021469 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.021782 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.022095 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.022405 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.022743 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.023468 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.023795 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.024107 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.024419 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.024732 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.025060 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.025375 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.025686 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.026019 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.026331 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.026639 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.026995 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.027703 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.028023 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.028379 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.028654 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.029145 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.029643 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.030119 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.030576 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.031080 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.031573 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.032057 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.032522 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.032985 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.033461 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.033928 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.034414 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.035906 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.036402 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.036893 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.037367 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.037857 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.038625 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.039179 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.039735 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.040263 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.040801 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.041338 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.041848 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.042352 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.042901 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.043455 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.043958 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.044463 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.045024 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.045519 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.046108 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.046645 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.047234 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.047754 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.048263 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.048787 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.049361 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.049934 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.050469 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.051672 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.052304 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.052699 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.053291 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.053637 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.053981 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.054308 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.054631 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.055763 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.055763 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.055763 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.057081 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.057802 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.058330 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.058661 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.059259 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.059602 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.059929 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.060296 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.060625 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.060953 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.061277 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.061620 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.061928 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.062248 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.062565 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.062904 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.063215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.063529 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.063846 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.064160 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.064489 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.064825 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.065139 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.065477 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.065788 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.066109 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.067233 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.067975 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.068300 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.068620 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.068941 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.069254 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.069586 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.069903 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.070215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.070543 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.070876 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.071191 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.071515 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.071829 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.072146 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.072462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.072776 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.073105 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.073422 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.073738 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.074078 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.074416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.074726 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.075080 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.075233 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 28 03:58:43.075720 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.075869 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 28 03:58:43.076030 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.079098 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 28 03:58:43.079194 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.079194 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.079328 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 28 03:58:43.079328 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 28 03:58:43.079456 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.079456 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.079605 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.079677 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.079747 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.079823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.079903 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.079975 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.080051 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.080122 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.080198 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.080268 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.080346 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.080417 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.080485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.080576 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.080657 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.080728 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.080806 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.080885 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.080971 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.081054 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.081125 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.081203 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.081297 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-799871-47-iscsi {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.081372 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.081442 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.081510 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.081510 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.081756 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.081839 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.081944 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.082023 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.082095 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.082224 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.082649 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.082767 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.083066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.083153 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.083393 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.083501 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.083707 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.083962 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.084188 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.084313 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.084404 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.084632 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.084771 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.084878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.085066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.085219 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.085382 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.085530 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.085679 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.085831 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.085979 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.086122 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.086271 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.086413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.086560 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.086708 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.086895 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.087041 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.087211 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.087428 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.087522 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-799871-47-iscsi {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.087745 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.087912 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.088068 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.088225 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.089722 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.089911 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.089911 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.090220 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.090383 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.090538 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.090829 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.091003 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.091245 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.091426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.091574 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.091728 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.091881 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.092027 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.092182 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.092335 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.092480 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.092633 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.092779 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.092931 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.093083 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.093227 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.093394 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.093551 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.093704 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.093849 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.093998 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.094143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.094315 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.094462 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.094618 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.094763 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.094989 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.095135 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.095135 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.095438 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.095584 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.095735 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.095888 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.096040 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.096198 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.096350 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.096502 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.096662 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.096814 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.096968 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.097113 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.097278 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.097432 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.097610 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.097758 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.097758 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.098043 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.098187 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.098337 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.098490 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.098644 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.098815 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.098968 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.099132 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.099286 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.099438 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.099595 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.099595 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.099887 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.100032 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.100180 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.100293 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.100421 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.100533 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.100651 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.100791 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.101069 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.101229 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.101389 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.101542 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.101693 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.101846 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.101992 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.46 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.102091 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.102192 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.46 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.102279 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.102352 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.102449 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.102536 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.102630 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.102756 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.102941 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.103087 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.103178 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.103275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.103371 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.103459 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.103550 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.103550 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.103835 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.103835 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.104065 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.104165 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.104262 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.104355 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.104441 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.104681 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.104798 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.104988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.105083 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.105242 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.105336 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.105543 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.105636 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.105847 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.105948 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.106165 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.106258 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.106473 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.106568 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.106798 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.106907 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.107120 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.107260 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.107422 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.107516 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.107730 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.107823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.108036 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.108141 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.108341 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.108444 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.108648 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.108741 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.108954 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.109061 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.109259 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.109402 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.109565 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.109700 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.109868 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.109977 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.110169 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.110265 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.110485 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.110585 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.110819 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.111114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.111221 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.111429 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.111521 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.111737 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.111839 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.112045 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.112150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.112366 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.112475 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.112680 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.112786 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.112990 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.113110 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.113881 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.114316 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.114411 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.114646 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.114753 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.114989 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.115084 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.115299 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.115404 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.115610 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.115719 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.115921 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.116013 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.116228 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.116328 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.116534 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.116635 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.116842 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.116934 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.117154 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.117256 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.117461 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.117556 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.117765 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.117866 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.118069 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.118208 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.118374 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.118476 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.118680 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.118773 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.119009 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.119101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.119311 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.119404 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.119616 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.119768 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.119901 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.120032 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.120226 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.120330 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.120531 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.120631 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.120838 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.120942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.121143 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.121250 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.121448 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.121539 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.121769 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 28 03:58:43.121873 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.122108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.122202 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.122439 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.122539 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.122844 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.122964 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.123114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.123216 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.123424 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.123531 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.123749 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.123845 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.124056 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.124152 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.124363 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.124457 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.124668 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.124763 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.124979 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.125074 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.125291 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.125389 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.125594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.125686 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.125905 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.125996 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.126211 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.126302 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.126524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.126630 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.126862 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.126973 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.127170 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.127274 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.127479 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.127622 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.127786 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.127890 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.128095 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.128197 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.128404 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.128498 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.128708 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.129350 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.129632 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.129947 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.130084 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.130258 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.130411 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.130563 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.130765 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.130921 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.131143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.131241 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.131464 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.131561 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.131789 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.131890 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.132098 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.132192 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.132404 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.132509 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.132715 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.132811 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.133025 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.133127 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.133331 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.133427 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.133657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.133751 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.133968 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.134106 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.134274 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.134371 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.134581 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.134683 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.134914 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.135015 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.135220 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.135329 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.135523 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.135617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.135834 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.135936 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.136157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.136270 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.136476 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.136571 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.136787 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.136889 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.137096 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.137269 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.137400 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.137495 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.137706 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.137801 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.138010 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.138114 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.138319 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.138414 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.138621 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.138723 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.138951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.139057 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.139258 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.139351 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.139561 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.139662 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.139864 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.140004 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.140186 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.140277 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.140493 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.140584 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.140801 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.140903 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.141108 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.141198 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.141414 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.141510 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.141736 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.141829 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.142051 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.142144 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.142363 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.142465 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.142680 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.142831 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.143023 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.143116 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.143338 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.143449 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.143648 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.143747 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.143960 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.144052 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.144274 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.144398 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.144630 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.144944 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.145179 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.145282 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.145528 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.145636 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.145850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.145944 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.146152 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.146253 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.146476 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.146591 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.146807 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.146915 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.147125 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.147222 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.147440 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.147533 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.147755 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.147848 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.148080 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.148179 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.148389 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.148491 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.148699 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.148794 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.149012 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.149113 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.149322 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.149424 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.149632 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.149726 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.149941 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.150090 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.150254 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.150356 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.150567 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.150669 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.150904 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.151020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.151215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.151316 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.151522 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.151617 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.151827 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.151928 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.152131 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.152223 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.152437 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.152536 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.152741 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.152851 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.153047 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.153146 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.153354 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.153447 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.153655 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.153748 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.153958 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.154055 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.154286 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.154598 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.154706 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.154931 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.155027 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.155237 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.155342 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.155543 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.155676 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.155888 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.155981 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.156198 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.156291 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.156546 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.156653 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.156888 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.156988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.157199 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.157307 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.157515 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.157618 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.157827 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.157955 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.158132 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.158224 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.158445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.158547 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.158762 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.158930 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.159102 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.159241 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.159417 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.159522 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.159740 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.159842 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.160099 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.160240 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.160491 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.160823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.160916 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.161135 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.161273 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.161445 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.161590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.161752 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.161856 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.162079 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.162176 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.162391 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.162487 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.162714 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.162828 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.163115 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.163470 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.163716 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.163818 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.164023 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.164118 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.164356 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.164491 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.164673 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.164778 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.164992 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.165094 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.165306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.165414 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.165623 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.165725 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.165939 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.166040 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.166254 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.166406 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.166575 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.166667 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.166921 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.167018 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.167245 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.167357 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.167559 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.167652 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.167889 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.167982 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.168204 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.168313 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.168511 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.168613 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.168821 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.168912 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.169139 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.169246 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.169454 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.169589 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.169779 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.169881 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.170092 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.170185 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.170406 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.170510 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.170732 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.170888 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.171073 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.171168 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.171386 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.171487 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.171701 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.171824 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.172014 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.172120 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.172323 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.172417 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.172643 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.172746 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.172949 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.173042 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.173260 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.173354 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.173572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.173674 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.173875 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.173976 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.174187 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.174307 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.174500 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.174636 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.174838 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.174953 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.175131 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.175231 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.175445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.175552 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.176271 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.176603 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.176802 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.176914 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.177130 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.177237 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.177464 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.177557 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.177794 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.177887 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.178107 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.178242 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.178420 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.178521 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.178738 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.178866 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.179070 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.179175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.179378 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.179474 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.179686 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.179785 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.179995 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.180097 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.180325 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.180464 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.180642 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.180744 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.180952 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.181046 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.181271 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.181364 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.181596 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.181702 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.181914 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.182030 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.182229 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.182322 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.182541 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.182648 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.182878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.182976 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.183186 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.183278 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.183491 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.183601 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.183802 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.183905 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.184109 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.184211 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.184415 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.184523 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.184723 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.184845 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.185031 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.185133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.185336 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.185431 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.185639 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.185749 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.185942 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.186036 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.186253 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.186346 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.186560 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.186660 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.186906 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.187003 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.187219 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.187320 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.187527 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.187789 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.187892 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.188127 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.188231 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.188448 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.188546 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.188761 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.188854 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.189082 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.189183 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.189402 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.189503 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.189726 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.189865 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.190053 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.190147 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.190363 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.190463 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.190690 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.190816 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.191034 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.191142 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.191997 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.192249 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.192344 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.192569 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.192671 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.192887 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.192987 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.193202 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.193295 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.193515 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.193615 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.193824 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.193917 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.194137 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.194231 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.194468 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.194603 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.194759 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.194931 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.195094 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.195309 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.195432 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.195641 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.195769 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.195959 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.196081 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.196277 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.196411 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.196592 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.196722 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.196913 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.197035 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.197224 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.197492 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.197613 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.197813 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.197949 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.198122 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.198243 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.198435 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.198555 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.198750 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.198911 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.199105 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.199227 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.199430 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.199528 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.199758 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.199854 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.200098 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.200203 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.200419 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.200513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.200740 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.200839 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.201046 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.201137 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.201354 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.201447 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.201660 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.201754 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.201974 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.202132 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.202285 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.202395 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.202591 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.202685 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.202931 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.203042 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.203244 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.203348 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.203557 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.203651 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.203867 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.203965 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.204174 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.204421 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.204523 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.204743 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.204833 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.205057 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.205165 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.205370 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.205473 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.205676 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.205778 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.205982 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.206077 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.206295 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.206388 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.206606 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.206710 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.207000 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.207143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.207323 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.207643 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.207821 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.207969 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.208138 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.208462 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.208556 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.208775 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.208869 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.209091 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.209196 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.209402 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.209496 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.209717 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.209820 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.210031 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.210126 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.210339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.210432 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.210666 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.210776 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.210999 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.211102 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.211308 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.211408 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.211617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.211720 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.211925 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.212056 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.212232 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.212370 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.212539 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.212647 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.212851 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.212942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.213157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.213279 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.213478 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.213608 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.213783 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.213903 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.214098 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.214317 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.214449 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.214670 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.214822 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.215016 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.215138 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.215324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.215455 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.215631 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.215761 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.215939 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.216061 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.216246 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.216376 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.216553 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.216684 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.216859 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.216982 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.217173 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.217268 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.217482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.217575 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.217790 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.217884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.218095 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.218192 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.218397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.218497 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.218708 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.218830 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.219046 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.219194 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.219352 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.219449 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.219665 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.219759 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.219970 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.220066 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.220297 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.220392 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.220607 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.220760 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.220900 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.220991 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.221206 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.221300 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.221517 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.221623 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.221821 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.221922 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.222126 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.222257 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.222431 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.223222 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.223322 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.223594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.223784 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.223900 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.224103 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.224212 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.224437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.224540 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.224758 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.224860 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.225077 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.225184 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.225397 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.225489 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.225725 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.225818 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.226058 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.226198 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.226367 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.226461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.226674 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.226777 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.227019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.227120 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.227335 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.227443 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.227651 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.227756 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.227967 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.228062 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.228284 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.228387 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.228600 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.228702 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.228913 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.229009 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.229228 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.229511 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.229607 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.229836 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.229938 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.230146 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.230241 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.230457 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.230550 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.230763 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.230912 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.231111 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.231207 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.231424 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.231524 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.231729 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.231830 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.232039 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.232141 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.232344 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.232488 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.232654 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.232749 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.232958 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.233051 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.233320 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.233431 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.233583 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.233683 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.233896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.233992 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.234209 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.234313 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.234522 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.234617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.234861 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.234961 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.235175 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.235289 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.235488 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.235590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.235798 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.235891 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.236106 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.236201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.236419 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.236548 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.236736 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.236858 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.237078 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.237184 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.237405 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.237498 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.237711 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.237812 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.238025 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.238178 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.238962 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.239290 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.239439 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.239603 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.239711 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.239917 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.240021 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.240230 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.240327 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.240547 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.240643 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.240882 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.241022 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.241200 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.241303 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.241510 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.241646 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.241934 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.242036 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.242249 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.242344 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.242572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.242670 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.242918 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.243038 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.243236 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.243345 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.243559 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.243661 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.243884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.243979 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.244197 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.244301 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.244519 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.244622 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.244831 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.244933 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.245142 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.245311 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.245472 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.245575 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.245800 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.245894 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.246114 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.246221 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.246422 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.246523 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.246728 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.246845 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.247061 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.247155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.247372 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.247474 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.247697 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.247797 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.248009 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.248110 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.248316 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.248425 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.248622 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.248725 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.248934 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.249081 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.249240 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.249343 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.249545 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.249657 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.249851 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.249945 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.250156 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.250258 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.250465 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.250569 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.250768 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.250880 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.251093 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.251240 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.251399 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.251508 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.251703 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.251805 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.252008 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.252110 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.252312 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.252421 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.252648 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.252756 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.252921 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.253024 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.253228 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.253324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.253531 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.253627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.253874 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.254181 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.254290 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.254517 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.254612 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.254875 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.254976 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.255193 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.255312 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.255519 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.255622 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.255829 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.255924 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.256153 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.256259 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.256460 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.256555 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.256782 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.256877 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.257089 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.257190 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.257399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.257501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.257715 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.257806 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.258043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.258137 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.258354 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.258447 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.258666 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.258768 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.259007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.259139 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.259319 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.259423 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.259631 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.259734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.259942 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.260038 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.260272 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.260366 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.260598 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.260704 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.260903 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.260996 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.261223 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.261316 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.261531 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.261639 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.261843 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.261944 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.262151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.262281 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.262459 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.262569 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.262766 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.262926 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.263101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.263196 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.263412 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.263508 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.263718 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.263810 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.264023 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.264117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.264332 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.264426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.264645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.264746 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.264955 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.265048 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.265268 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.265363 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.265575 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.265701 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.265885 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.265981 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.266191 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.266293 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.266526 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.266663 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.266856 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.266989 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.267185 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.267306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.267504 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.267605 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.267830 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.267939 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.268162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.268473 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.268575 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.268800 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.268903 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.269120 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.269259 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.269525 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.269686 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.269829 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.270000 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.270165 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.270393 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.270557 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118186) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 03:58:43.270722 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.271072 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.271396 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.271713 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.272034 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.272355 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.272676 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.273230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.273561 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.273879 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.274198 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.274513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.274854 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.275174 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.275489 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.275804 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.276117 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.276433 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.276765 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.277090 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.277420 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.277763 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.278085 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.278404 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.278725 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.279073 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.279436 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.279754 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.280066 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.280384 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.280701 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.281018 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.281332 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.281645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.281960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.282274 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.282590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.282966 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.283282 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.283625 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.284003 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.284349 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.285500 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.286100 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.286439 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.286769 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.287590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.287790 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.288145 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.288734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.289282 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.289436 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.289800 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.290176 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.290571 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.291107 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.291260 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.291654 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.292040 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.292389 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.292708 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.293127 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.293529 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.293860 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.294514 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.295315 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.295315 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.295639 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.296009 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.296443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.296732 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.297079 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.297425 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.297777 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.298335 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.298590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.299133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.299521 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.299890 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.300283 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.301276 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.301694 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.302163 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.302579 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.303063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.303247 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.303595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.303909 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.304403 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.304629 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.305019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.305439 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.305787 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.306176 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.306501 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.306838 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.307160 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.307473 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.307790 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.308150 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.308484 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.308797 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.309107 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.309431 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.309845 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.310176 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.310496 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.310835 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.311193 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.311515 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.312066 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.312406 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.312735 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.313076 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.313422 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.313737 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.314053 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.314380 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.314699 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.315042 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.315362 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.315679 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.315999 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.316338 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.317092 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.317417 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.317738 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.318056 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.318373 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.318691 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.319033 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.319349 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.319665 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.319986 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.320336 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.320661 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.320984 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.321305 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.321647 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.321945 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.322259 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.322572 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.322911 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.323232 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.323571 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.323890 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.324201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.324630 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.324946 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.325269 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.325596 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.325909 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.326236 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.326563 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.326901 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.327230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.327544 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.327878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.328522 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.328637 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.328874 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.329187 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.329497 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.329807 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.330120 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.330445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.330760 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.331092 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.331398 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.331712 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.332515 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.332836 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.333147 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.333459 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.333779 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.334087 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.334397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.334707 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.335043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.335354 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.335663 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.335977 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.336286 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.336596 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.336903 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.337212 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.337518 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.337853 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO dbcounter [None req-7ad02f38-34b9-4bc7-8b90-62de9d4a8455 None None] Registered counter for database nova_api Jul 28 03:58:43.337953 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.338189 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.338508 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.338857 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.339174 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.339498 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.339810 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.340136 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.340461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.340780 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.341095 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.341432 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.341744 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.342058 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.342373 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.342685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.343028 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.343349 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.343683 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.344015 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.344326 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.344655 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.344975 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.345296 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.345613 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.345925 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.346256 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.346571 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.346911 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.347226 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.348107 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.348931 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.349253 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.349574 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.349895 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.350219 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.350545 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.350913 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.351247 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.351563 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.351895 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.352224 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.352581 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.352897 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.353255 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.354151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.354500 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.354598 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.354876 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 28 03:58:43.355127 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118187) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 28 03:58:43.358730 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_db.sqlalchemy.engines [None req-7ad02f38-34b9-4bc7-8b90-62de9d4a8455 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118186) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:58:43.366520 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writer thread running {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:58:43.419347 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO dbcounter [None req-f2d9d77d-9070-423d-aaaf-4de154c1e051 None None] Registered counter for database nova_api Jul 28 03:58:43.423345 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.context [None req-7ad02f38-34b9-4bc7-8b90-62de9d4a8455 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),914ca376-756b-4795-b8c4-6a0f18f31607(cell1) {{(pid=118186) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 03:58:43.428143 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7ad02f38-34b9-4bc7-8b90-62de9d4a8455 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:43.429717 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7ad02f38-34b9-4bc7-8b90-62de9d4a8455 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:43.430526 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7ad02f38-34b9-4bc7-8b90-62de9d4a8455 None None] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:43.432568 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7ad02f38-34b9-4bc7-8b90-62de9d4a8455 None None] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:43.434592 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO dbcounter [None req-7ad02f38-34b9-4bc7-8b90-62de9d4a8455 None None] Registered counter for database nova_cell0 Jul 28 03:58:43.438670 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO dbcounter [None req-7ad02f38-34b9-4bc7-8b90-62de9d4a8455 None None] Registered counter for database nova_cell1 Jul 28 03:58:43.440286 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_db.sqlalchemy.engines [None req-f2d9d77d-9070-423d-aaaf-4de154c1e051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:58:43.446271 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_db.sqlalchemy.engines [None req-7ad02f38-34b9-4bc7-8b90-62de9d4a8455 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118186) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:58:43.447936 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_db.sqlalchemy.engines [None req-7ad02f38-34b9-4bc7-8b90-62de9d4a8455 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118186) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:58:43.449709 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writer thread running {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:58:43.453928 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writer thread running {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:58:43.456034 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writer thread running {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:58:43.510256 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.context [None req-f2d9d77d-9070-423d-aaaf-4de154c1e051 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),914ca376-756b-4795-b8c4-6a0f18f31607(cell1) {{(pid=118187) load_cells /opt/stack/nova/nova/context.py:464}} Jul 28 03:58:43.514278 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f2d9d77d-9070-423d-aaaf-4de154c1e051 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:43.515876 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f2d9d77d-9070-423d-aaaf-4de154c1e051 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:43.516670 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f2d9d77d-9070-423d-aaaf-4de154c1e051 None None] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:58:43.518665 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f2d9d77d-9070-423d-aaaf-4de154c1e051 None None] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:58:43.521434 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO dbcounter [None req-f2d9d77d-9070-423d-aaaf-4de154c1e051 None None] Registered counter for database nova_cell0 Jul 28 03:58:43.525434 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO dbcounter [None req-f2d9d77d-9070-423d-aaaf-4de154c1e051 None None] Registered counter for database nova_cell1 Jul 28 03:58:43.534416 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_db.sqlalchemy.engines [None req-f2d9d77d-9070-423d-aaaf-4de154c1e051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:58:43.541570 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_db.sqlalchemy.engines [None req-f2d9d77d-9070-423d-aaaf-4de154c1e051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:58:43.542600 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writer thread running {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:58:43.604720 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO dbcounter [None req-7ad02f38-34b9-4bc7-8b90-62de9d4a8455 None None] Registered counter for database nova_cell0 Jul 28 03:58:43.611689 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_db.sqlalchemy.engines [None req-7ad02f38-34b9-4bc7-8b90-62de9d4a8455 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118186) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:58:43.617515 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writer thread running {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:58:43.689291 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writer thread running {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:58:43.700067 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO dbcounter [None req-f2d9d77d-9070-423d-aaaf-4de154c1e051 None None] Registered counter for database nova_cell0 Jul 28 03:58:43.707502 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_db.sqlalchemy.engines [None req-f2d9d77d-9070-423d-aaaf-4de154c1e051 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118187) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 28 03:58:43.712548 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writer thread running {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 28 03:58:43.943874 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: WARNING keystonemiddleware.auth_token [None req-7ad02f38-34b9-4bc7-8b90-62de9d4a8455 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:58:43.951213 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: WARNING keystonemiddleware.auth_token [None req-7ad02f38-34b9-4bc7-8b90-62de9d4a8455 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:58:44.044035 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: WARNING keystonemiddleware.auth_token [None req-f2d9d77d-9070-423d-aaaf-4de154c1e051 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:58:44.051941 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: WARNING keystonemiddleware.auth_token [None req-f2d9d77d-9070-423d-aaaf-4de154c1e051 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:58:44.299609 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: WARNING keystonemiddleware.auth_token [None req-7ad02f38-34b9-4bc7-8b90-62de9d4a8455 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:58:44.306969 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: WARNING keystonemiddleware.auth_token [None req-7ad02f38-34b9-4bc7-8b90-62de9d4a8455 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:58:44.312779 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5626ead6a9c0 pid: 118186 (default app) Jul 28 03:58:44.412923 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: WARNING keystonemiddleware.auth_token [None req-f2d9d77d-9070-423d-aaaf-4de154c1e051 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 28 03:58:44.419183 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: WARNING keystonemiddleware.auth_token [None req-f2d9d77d-9070-423d-aaaf-4de154c1e051 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 28 03:58:44.424525 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5626ead6a9c0 pid: 118187 (default app) Jul 28 03:59:25.427886 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=3 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:25.430087 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=3 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:25.431725 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell0:SELECT=3 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:25.432696 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell0:SELECT=3 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:27.235085 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-e4d538f3-9514-4a8a-ae62-6acfe0a84aec tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Action: 'create', calling method: .version_select at 0x7fa6f00d0d30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-647011616"}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:30.130475 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-e4d538f3-9514-4a8a-ae62-6acfe0a84aec tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.724515 Jul 28 03:59:30.140320 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 1/1] 10.222.0.46 () {60 vars in 1155 bytes} [Thu Jul 28 03:59:25 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4736 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 03:59:30.937960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-cf6b594d-3bd2-457a-8b91-9c64877f3eb7 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Calling method '.version_select at 0x7fa6f0194820>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:31.039016 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=3 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:31.040530 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=3 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:31.042097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=3 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:31.043710 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=3 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 03:59:31.732351 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-cf6b594d-3bd2-457a-8b91-9c64877f3eb7 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/52ff2bc8-efe0-468f-803e-970b3a4114ad" status: 200 len: 345 microversion: 2.1 time: 1.589552 Jul 28 03:59:31.733433 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 1/2] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 03:59:30 2022] GET /compute/v2.1/os-volumes/52ff2bc8-efe0-468f-803e-970b3a4114ad => generated 345 bytes in 1593 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:59:31.754223 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-bb86c1f8-3181-44ee-b07a-e06375e2b2b5 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Action: 'create', calling method: .version_select at 0x7fa6eff3aaf0>, body: {"snapshot": {"volume_id": "52ff2bc8-efe0-468f-803e-970b3a4114ad", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-2013554440"}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:32.592633 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-bb86c1f8-3181-44ee-b07a-e06375e2b2b5 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] 10.222.0.46 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.848305 Jul 28 03:59:32.602914 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 2/3] 10.222.0.46 () {60 vars in 1162 bytes} [Thu Jul 28 03:59:31 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 859 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:32.605155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7e6cb6a5-990a-4fa8-827f-302a4c9c6d99 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Calling method '.version_select at 0x7fa6effe8b80>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:32.724489 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7e6cb6a5-990a-4fa8-827f-302a4c9c6d99 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/e626a168-cbc8-4eaf-a3ad-7cd3d12382af" status: 200 len: 287 microversion: 2.1 time: 0.123391 Jul 28 03:59:32.726397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 2/4] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Jul 28 03:59:32 2022] GET /compute/v2.1/os-snapshots/e626a168-cbc8-4eaf-a3ad-7cd3d12382af => generated 287 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:59:32.739437 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-69d350f4-7de1-4c27-81da-336a19b1915c tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Calling method '.version_select at 0x7fa6eff4cca0>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:32.857592 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-69d350f4-7de1-4c27-81da-336a19b1915c tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.122967 Jul 28 03:59:32.866529 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 3/5] 10.222.0.46 () {58 vars in 1140 bytes} [Thu Jul 28 03:59:32 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:32.871473 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c24fa33f-286e-4eb1-8637-e255085f7380 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Calling method '.version_select at 0x7fa6effe8c10>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:32.944092 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c24fa33f-286e-4eb1-8637-e255085f7380 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/e626a168-cbc8-4eaf-a3ad-7cd3d12382af" status: 200 len: 287 microversion: 2.1 time: 0.077260 Jul 28 03:59:32.944668 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 3/6] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Jul 28 03:59:32 2022] GET /compute/v2.1/os-snapshots/e626a168-cbc8-4eaf-a3ad-7cd3d12382af => generated 287 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:33.967370 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-d2178ea8-779d-4e80-9f29-46d1c3caf9c9 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Calling method '.version_select at 0x7fa6eff4cb80>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:34.013275 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-d2178ea8-779d-4e80-9f29-46d1c3caf9c9 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/e626a168-cbc8-4eaf-a3ad-7cd3d12382af" status: 200 len: 287 microversion: 2.1 time: 0.059038 Jul 28 03:59:34.013855 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 4/7] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Jul 28 03:59:33 2022] GET /compute/v2.1/os-snapshots/e626a168-cbc8-4eaf-a3ad-7cd3d12382af => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 03:59:35.028108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9c9b5c9c-98ad-4f03-a042-57f563360537 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Calling method '.version_select at 0x7fa6effaa3a0>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:35.213557 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9c9b5c9c-98ad-4f03-a042-57f563360537 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/e626a168-cbc8-4eaf-a3ad-7cd3d12382af" status: 200 len: 287 microversion: 2.1 time: 0.191355 Jul 28 03:59:35.214136 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 4/8] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Jul 28 03:59:35 2022] GET /compute/v2.1/os-snapshots/e626a168-cbc8-4eaf-a3ad-7cd3d12382af => generated 287 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:36.227069 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-fcfc6437-9c4d-4963-8d88-06a9a89d6ce2 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Calling method '.version_select at 0x7fa6eff4c550>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:36.293978 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-fcfc6437-9c4d-4963-8d88-06a9a89d6ce2 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/e626a168-cbc8-4eaf-a3ad-7cd3d12382af" status: 200 len: 287 microversion: 2.1 time: 0.071187 Jul 28 03:59:36.294892 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 5/9] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Jul 28 03:59:36 2022] GET /compute/v2.1/os-snapshots/e626a168-cbc8-4eaf-a3ad-7cd3d12382af => generated 287 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:36.976540 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-23a13552-3946-45a3-8d44-a348cb3b3778 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Action: 'create', calling method: .version_select at 0x7fa6effaa9d0>, body: {"keypair": {"name": "tempest-keypair-1655261939", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKywETbfValqn4WuqC9Yz9FCpb0y8hE1XROR9HG2GSQRER8BO8EXzD1JBzxeFDgMOuw1NxvmJi1cNIHfkBP2vHnwm/aHjx66t2RHKLQpqpmsJyxk6FeXJ65XbiZCQfkA/A=="}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:37.131716 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-23a13552-3946-45a3-8d44-a348cb3b3778 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Getting quotas for project 18a927e9f5da42d7b34752c8b2db211a. Resources: {'key_pairs'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:59:37.158129 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-23a13552-3946-45a3-8d44-a348cb3b3778 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Getting quotas for user c3308761e9d2495e95e127bbc7b9c5e2 and project 18a927e9f5da42d7b34752c8b2db211a. Resources: {'key_pairs'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:59:37.309214 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-19d92836-9738-4121-acb8-b0d821eacf7a tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Calling method '.version_select at 0x7fa6eff3af70>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:37.321174 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-23a13552-3946-45a3-8d44-a348cb3b3778 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.887202 Jul 28 03:59:37.323204 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 5/10] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 03:59:36 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 890 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:37.400645 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-19d92836-9738-4121-acb8-b0d821eacf7a tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/e626a168-cbc8-4eaf-a3ad-7cd3d12382af" status: 200 len: 288 microversion: 2.1 time: 0.096502 Jul 28 03:59:37.401200 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 6/11] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Jul 28 03:59:37 2022] GET /compute/v2.1/os-snapshots/e626a168-cbc8-4eaf-a3ad-7cd3d12382af => generated 288 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:37.415697 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-09fb9fd1-2088-4fd7-bd05-9d59d302a006 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Calling method '.version_select at 0x7fa6eff1af70>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:37.589011 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-09fb9fd1-2088-4fd7-bd05-9d59d302a006 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] 10.222.0.46 "DELETE /compute/v2.1/os-snapshots/e626a168-cbc8-4eaf-a3ad-7cd3d12382af" status: 202 len: 0 microversion: 2.1 time: 0.178414 Jul 28 03:59:37.592899 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 6/12] 10.222.0.46 () {58 vars in 1254 bytes} [Thu Jul 28 03:59:37 2022] DELETE /compute/v2.1/os-snapshots/e626a168-cbc8-4eaf-a3ad-7cd3d12382af => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 03:59:37.599602 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a45ef2e4-f249-408a-9cbc-213e1689d880 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Calling method '.version_select at 0x7fa6eff3ae50>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:37.685614 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-a45ef2e4-f249-408a-9cbc-213e1689d880 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/e626a168-cbc8-4eaf-a3ad-7cd3d12382af" status: 200 len: 287 microversion: 2.1 time: 0.091449 Jul 28 03:59:37.687116 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 7/13] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Jul 28 03:59:37 2022] GET /compute/v2.1/os-snapshots/e626a168-cbc8-4eaf-a3ad-7cd3d12382af => generated 287 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:38.700307 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-77bc59f5-a240-4bbe-b733-6bf5b8e35588 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Calling method '.version_select at 0x7fa6eff39670>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:38.752170 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-77bc59f5-a240-4bbe-b733-6bf5b8e35588 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] HTTP exception thrown: Snapshot e626a168-cbc8-4eaf-a3ad-7cd3d12382af could not be found. Jul 28 03:59:38.758445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-77bc59f5-a240-4bbe-b733-6bf5b8e35588 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Request method failure captured: Jul 28 03:59:38.758445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/os-snapshots/e626a168-cbc8-4eaf-a3ad-7cd3d12382af HTTP/1.1 Jul 28 03:59:38.758445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 03:59:38.758445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 03:59:38.758445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 03:59:38.758445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 03:59:38.758445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 03:59:38.758445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 03:59:38.758445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 03:59:38.758445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 03:59:38.758445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gmdGux63KCB_3XTcVqaCMxqUP-jIX6bMhkbRC4S5f6w7yM6Od3OaUzpouoImV9nRIB0JD_2ivInYBzkujQtwn-bDuUjyjTSMIBNPmvSKEN8Pnns3CUrFCJas-c7FE5zQPDjKiin5uykyRASX4fM9E3N7dXEeKpGry2_qUJL6vD9bwA Jul 28 03:59:38.758445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 03:59:38.758445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 03:59:38.758445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 03:59:38.758445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 03:59:38.758445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 03:59:38.758445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 03:59:38.758445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 726a1ad14d374061a5db26470f86fdf7 Jul 28 03:59:38.758445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-996543154 Jul 28 03:59:38.758445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 03:59:38.758445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 03:59:38.759548 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_726a1ad14d374061a5db26470f86fdf7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/726a1ad14d374061a5db26470f86fdf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/726a1ad14d374061a5db26470f86fdf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/726a1ad14d374061a5db26470f86fdf7"}]}] Jul 28 03:59:38.759548 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-VolumesSnapshotsTestJSON-996543154 Jul 28 03:59:38.759548 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 726a1ad14d374061a5db26470f86fdf7 Jul 28 03:59:38.759548 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-996543154 Jul 28 03:59:38.759548 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-VolumesSnapshotsTestJSON-996543154-project Jul 28 03:59:38.759548 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 03:59:38.759548 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 03:59:38.759548 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: 4dab551c284242df98e62efdc5de8de7 Jul 28 03:59:38.759548 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-VolumesSnapshotsTestJSON-996543154-project Jul 28 03:59:38.759548 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: Jul 28 03:59:38.759548 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Snapshot e626a168-cbc8-4eaf-a3ad-7cd3d12382af could not be found. Jul 28 03:59:38.759548 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': 'e626a168-cbc8-4eaf-a3ad-7cd3d12382af'} Jul 28 03:59:38.759548 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:59:38.760162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:38.760162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 03:59:38.760162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 03:59:38.760162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 03:59:38.760162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 03:59:38.760162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 03:59:38.760162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 03:59:38.760162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 03:59:38.760162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 03:59:38.760162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 03:59:38.760162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 03:59:38.760162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:59:38.760162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:59:38.760162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:59:38.760162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:59:38.760162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot e626a168-cbc8-4eaf-a3ad-7cd3d12382af could not be found. (HTTP 404) (Request-ID: req-3f955528-0fd3-4457-b2be-383e16a4b92c) Jul 28 03:59:38.760162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:38.760162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:38.760990 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:38.760990 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:38.760990 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 28 03:59:38.760990 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 28 03:59:38.760990 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 03:59:38.760990 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 03:59:38.760990 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 28 03:59:38.760990 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 28 03:59:38.760990 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 03:59:38.760990 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 03:59:38.760990 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 28 03:59:38.760990 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 28 03:59:38.760990 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 28 03:59:38.760990 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 28 03:59:38.760990 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 28 03:59:38.760990 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 28 03:59:38.760990 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 03:59:38.760990 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 03:59:38.760990 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 03:59:38.761860 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 03:59:38.761860 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:59:38.761860 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:59:38.761860 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:59:38.761860 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:59:38.761860 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot e626a168-cbc8-4eaf-a3ad-7cd3d12382af could not be found. Jul 28 03:59:38.761860 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:38.761860 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:38.761860 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:38.761860 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:38.761860 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:38.761860 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:38.761860 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:59:38.761860 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:59:38.761860 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:59:38.761860 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:59:38.761860 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:59:38.761860 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:59:38.761860 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 28 03:59:38.761860 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:59:38.762870 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot e626a168-cbc8-4eaf-a3ad-7cd3d12382af could not be found. Jul 28 03:59:38.762870 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:38.762870 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:38.762870 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:38.762870 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:38.762870 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:38.762870 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:38.762870 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:59:38.762870 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:59:38.762870 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot e626a168-cbc8-4eaf-a3ad-7cd3d12382af could not be found. Jul 28 03:59:38.762870 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:38.762870 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-77bc59f5-a240-4bbe-b733-6bf5b8e35588 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Returning 404 to user: Snapshot e626a168-cbc8-4eaf-a3ad-7cd3d12382af could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:59:38.762870 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-77bc59f5-a240-4bbe-b733-6bf5b8e35588 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] 10.222.0.46 "GET /compute/v2.1/os-snapshots/e626a168-cbc8-4eaf-a3ad-7cd3d12382af" status: 404 len: 111 microversion: 2.1 time: 0.065693 Jul 28 03:59:38.770945 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-0c88bde8-7df3-40a4-ac60-9eaf98a6c0bd tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Calling method '.version_select at 0x7fa6eff4c4c0>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:38.778932 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 7/14] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Jul 28 03:59:38 2022] GET /compute/v2.1/os-snapshots/e626a168-cbc8-4eaf-a3ad-7cd3d12382af => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:59:38.922043 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-0c88bde8-7df3-40a4-ac60-9eaf98a6c0bd tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/52ff2bc8-efe0-468f-803e-970b3a4114ad" status: 202 len: 0 microversion: 2.1 time: 0.155453 Jul 28 03:59:38.931302 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 8/15] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Jul 28 03:59:38 2022] DELETE /compute/v2.1/os-volumes/52ff2bc8-efe0-468f-803e-970b3a4114ad => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:59:38.932704 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c5032f79-8fc5-458c-9d04-d70e59ccdaec tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Calling method '.version_select at 0x7fa6ef6394c0>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:39.115828 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c5032f79-8fc5-458c-9d04-d70e59ccdaec tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/52ff2bc8-efe0-468f-803e-970b3a4114ad" status: 200 len: 344 microversion: 2.1 time: 0.188034 Jul 28 03:59:39.116952 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 8/16] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 03:59:38 2022] GET /compute/v2.1/os-volumes/52ff2bc8-efe0-468f-803e-970b3a4114ad => generated 344 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:40.132848 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4c978631-3def-42ec-9f52-9aaa47bf7af2 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Calling method '.version_select at 0x7fa6ef639c10>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:40.279471 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4c978631-3def-42ec-9f52-9aaa47bf7af2 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/52ff2bc8-efe0-468f-803e-970b3a4114ad" status: 200 len: 344 microversion: 2.1 time: 0.153503 Jul 28 03:59:40.280823 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 9/17] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 03:59:40 2022] GET /compute/v2.1/os-volumes/52ff2bc8-efe0-468f-803e-970b3a4114ad => generated 344 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:40.348972 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-dfd4e054-0c52-4637-958b-d45315167889 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1963185341", "imageRef": "a0eec51c-83e9-420b-bcb9-20fe8dcf5321", "flavorRef": "452", "networks": [{"uuid": "ded0a554-4a41-41a4-8652-027402565a9d"}]}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:40.588667 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.network.neutron [None req-dfd4e054-0c52-4637-958b-d45315167889 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] validate_networks() for [('ded0a554-4a41-41a4-8652-027402565a9d', None, None, None, None, None)] {{(pid=118186) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:59:41.295827 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-99679265-b908-49e4-8f8f-e3361dc5a706 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Calling method '.version_select at 0x7fa6ef639ca0>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:41.350145 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-99679265-b908-49e4-8f8f-e3361dc5a706 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] HTTP exception thrown: Volume 52ff2bc8-efe0-468f-803e-970b3a4114ad could not be found. Jul 28 03:59:41.354988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-99679265-b908-49e4-8f8f-e3361dc5a706 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Request method failure captured: Jul 28 03:59:41.354988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/os-volumes/52ff2bc8-efe0-468f-803e-970b3a4114ad HTTP/1.1 Jul 28 03:59:41.354988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 03:59:41.354988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 03:59:41.354988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 03:59:41.354988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 03:59:41.354988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 03:59:41.354988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 03:59:41.354988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 03:59:41.354988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 03:59:41.354988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gmdGux63KCB_3XTcVqaCMxqUP-jIX6bMhkbRC4S5f6w7yM6Od3OaUzpouoImV9nRIB0JD_2ivInYBzkujQtwn-bDuUjyjTSMIBNPmvSKEN8Pnns3CUrFCJas-c7FE5zQPDjKiin5uykyRASX4fM9E3N7dXEeKpGry2_qUJL6vD9bwA Jul 28 03:59:41.354988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 03:59:41.354988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 03:59:41.354988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 03:59:41.354988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 03:59:41.354988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 03:59:41.354988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 03:59:41.354988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 726a1ad14d374061a5db26470f86fdf7 Jul 28 03:59:41.354988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-996543154 Jul 28 03:59:41.354988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 03:59:41.354988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 03:59:41.356304 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_726a1ad14d374061a5db26470f86fdf7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/726a1ad14d374061a5db26470f86fdf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/726a1ad14d374061a5db26470f86fdf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/726a1ad14d374061a5db26470f86fdf7"}]}] Jul 28 03:59:41.356304 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-VolumesSnapshotsTestJSON-996543154 Jul 28 03:59:41.356304 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 726a1ad14d374061a5db26470f86fdf7 Jul 28 03:59:41.356304 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-996543154 Jul 28 03:59:41.356304 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-VolumesSnapshotsTestJSON-996543154-project Jul 28 03:59:41.356304 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 03:59:41.356304 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 03:59:41.356304 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: 4dab551c284242df98e62efdc5de8de7 Jul 28 03:59:41.356304 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-VolumesSnapshotsTestJSON-996543154-project Jul 28 03:59:41.356304 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: Jul 28 03:59:41.356304 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Volume 52ff2bc8-efe0-468f-803e-970b3a4114ad could not be found. Jul 28 03:59:41.356304 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': '52ff2bc8-efe0-468f-803e-970b3a4114ad'} Jul 28 03:59:41.356304 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:59:41.356937 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:41.356937 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:59:41.356937 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:59:41.356937 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 03:59:41.356937 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 03:59:41.356937 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 03:59:41.356937 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 03:59:41.356937 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 03:59:41.356937 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 03:59:41.356937 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 03:59:41.356937 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 03:59:41.356937 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:59:41.356937 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:59:41.356937 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:59:41.356937 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:59:41.356937 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 52ff2bc8-efe0-468f-803e-970b3a4114ad could not be found. (HTTP 404) (Request-ID: req-e2a9c209-ea2d-4ea6-92e1-15bb5edbd85b) Jul 28 03:59:41.356937 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:41.356937 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:41.356937 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:41.357873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:41.357873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 03:59:41.357873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 03:59:41.357873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 03:59:41.357873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 03:59:41.357873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 03:59:41.357873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 03:59:41.357873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 03:59:41.357873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 03:59:41.357873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:59:41.357873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:59:41.357873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 03:59:41.357873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 03:59:41.357873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 03:59:41.357873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 03:59:41.357873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 03:59:41.357873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 03:59:41.357873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 03:59:41.357873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 03:59:41.358765 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:59:41.358765 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:59:41.358765 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:59:41.358765 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:59:41.358765 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 52ff2bc8-efe0-468f-803e-970b3a4114ad could not be found. Jul 28 03:59:41.358765 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:41.358765 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:41.358765 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:41.358765 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:41.358765 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:41.358765 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:41.358765 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:59:41.358765 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:59:41.358765 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:59:41.358765 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:59:41.358765 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:59:41.358765 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:59:41.358765 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 03:59:41.358765 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:59:41.359761 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 52ff2bc8-efe0-468f-803e-970b3a4114ad could not be found. Jul 28 03:59:41.359761 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:41.359761 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:41.359761 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:41.359761 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:41.359761 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:41.359761 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:41.359761 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:59:41.359761 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:59:41.359761 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 52ff2bc8-efe0-468f-803e-970b3a4114ad could not be found. Jul 28 03:59:41.359761 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:41.364212 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-99679265-b908-49e4-8f8f-e3361dc5a706 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Returning 404 to user: Volume 52ff2bc8-efe0-468f-803e-970b3a4114ad could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:59:41.365272 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-99679265-b908-49e4-8f8f-e3361dc5a706 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/52ff2bc8-efe0-468f-803e-970b3a4114ad" status: 404 len: 109 microversion: 2.1 time: 0.073837 Jul 28 03:59:41.366329 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 10/18] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 03:59:41 2022] GET /compute/v2.1/os-volumes/52ff2bc8-efe0-468f-803e-970b3a4114ad => generated 109 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:59:41.389801 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f6997bda-8e14-4f86-a7c7-5c2b01ade3b7 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Calling method '.version_select at 0x7fa6ef6523a0>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:41.510533 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-f6997bda-8e14-4f86-a7c7-5c2b01ade3b7 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] HTTP exception thrown: Volume 52ff2bc8-efe0-468f-803e-970b3a4114ad could not be found. Jul 28 03:59:41.512638 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f6997bda-8e14-4f86-a7c7-5c2b01ade3b7 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Request method failure captured: Jul 28 03:59:41.512638 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: DELETE /compute/v2.1/os-volumes/52ff2bc8-efe0-468f-803e-970b3a4114ad HTTP/1.1 Jul 28 03:59:41.512638 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 03:59:41.512638 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 03:59:41.512638 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 03:59:41.512638 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 03:59:41.512638 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 03:59:41.512638 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 03:59:41.512638 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 03:59:41.512638 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 03:59:41.512638 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gmdGux63KCB_3XTcVqaCMxqUP-jIX6bMhkbRC4S5f6w7yM6Od3OaUzpouoImV9nRIB0JD_2ivInYBzkujQtwn-bDuUjyjTSMIBNPmvSKEN8Pnns3CUrFCJas-c7FE5zQPDjKiin5uykyRASX4fM9E3N7dXEeKpGry2_qUJL6vD9bwA Jul 28 03:59:41.512638 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 03:59:41.512638 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 03:59:41.512638 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 03:59:41.512638 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 03:59:41.512638 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 03:59:41.512638 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 03:59:41.512638 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 726a1ad14d374061a5db26470f86fdf7 Jul 28 03:59:41.512638 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-996543154 Jul 28 03:59:41.512638 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 03:59:41.512638 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 03:59:41.513642 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_726a1ad14d374061a5db26470f86fdf7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/726a1ad14d374061a5db26470f86fdf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/726a1ad14d374061a5db26470f86fdf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/726a1ad14d374061a5db26470f86fdf7"}]}] Jul 28 03:59:41.513642 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-VolumesSnapshotsTestJSON-996543154 Jul 28 03:59:41.513642 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 726a1ad14d374061a5db26470f86fdf7 Jul 28 03:59:41.513642 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-996543154 Jul 28 03:59:41.513642 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-VolumesSnapshotsTestJSON-996543154-project Jul 28 03:59:41.513642 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 03:59:41.513642 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 03:59:41.513642 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: 4dab551c284242df98e62efdc5de8de7 Jul 28 03:59:41.513642 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-VolumesSnapshotsTestJSON-996543154-project Jul 28 03:59:41.513642 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: Jul 28 03:59:41.513642 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Volume 52ff2bc8-efe0-468f-803e-970b3a4114ad could not be found. Jul 28 03:59:41.513642 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': '52ff2bc8-efe0-468f-803e-970b3a4114ad'} Jul 28 03:59:41.513642 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:59:41.514241 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:41.514241 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:59:41.514241 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:59:41.514241 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 03:59:41.514241 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 03:59:41.514241 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 03:59:41.514241 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 03:59:41.514241 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 03:59:41.514241 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 03:59:41.514241 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 03:59:41.514241 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 03:59:41.514241 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:59:41.514241 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:59:41.514241 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:59:41.514241 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:59:41.514241 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 52ff2bc8-efe0-468f-803e-970b3a4114ad could not be found. (HTTP 404) (Request-ID: req-0f3ac9ac-42dc-4db2-8319-4e30fec9e018) Jul 28 03:59:41.514241 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:41.514241 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:41.514241 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:41.515280 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:41.515280 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 03:59:41.515280 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 03:59:41.515280 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 03:59:41.515280 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 03:59:41.515280 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 03:59:41.515280 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 03:59:41.515280 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 03:59:41.515280 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 03:59:41.515280 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:59:41.515280 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:59:41.515280 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 03:59:41.515280 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 03:59:41.515280 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 03:59:41.515280 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 03:59:41.515280 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 03:59:41.515280 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 03:59:41.515280 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 03:59:41.515280 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 03:59:41.516630 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:59:41.516630 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:59:41.516630 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:59:41.516630 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:59:41.516630 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 52ff2bc8-efe0-468f-803e-970b3a4114ad could not be found. Jul 28 03:59:41.516630 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:41.516630 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:41.516630 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:41.516630 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:41.516630 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:41.516630 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:41.516630 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:59:41.516630 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:59:41.516630 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:59:41.516630 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:59:41.516630 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:59:41.516630 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:59:41.516630 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 03:59:41.516630 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:59:41.518547 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 52ff2bc8-efe0-468f-803e-970b3a4114ad could not be found. Jul 28 03:59:41.518547 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:41.518547 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:41.518547 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:41.518547 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:41.518547 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:41.518547 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:41.518547 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:59:41.518547 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:59:41.518547 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 52ff2bc8-efe0-468f-803e-970b3a4114ad could not be found. Jul 28 03:59:41.518547 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:41.518547 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f6997bda-8e14-4f86-a7c7-5c2b01ade3b7 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Returning 404 to user: Volume 52ff2bc8-efe0-468f-803e-970b3a4114ad could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:59:41.518547 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f6997bda-8e14-4f86-a7c7-5c2b01ade3b7 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/52ff2bc8-efe0-468f-803e-970b3a4114ad" status: 404 len: 109 microversion: 2.1 time: 0.140396 Jul 28 03:59:41.518547 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 11/19] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Jul 28 03:59:41 2022] DELETE /compute/v2.1/os-volumes/52ff2bc8-efe0-468f-803e-970b3a4114ad => generated 109 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:59:41.523117 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-28c3f541-d405-4f48-856f-4a4060d5a853 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Calling method '.version_select at 0x7fa6ef639940>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:41.888125 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-28c3f541-d405-4f48-856f-4a4060d5a853 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] HTTP exception thrown: Volume 52ff2bc8-efe0-468f-803e-970b3a4114ad could not be found. Jul 28 03:59:41.890900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-28c3f541-d405-4f48-856f-4a4060d5a853 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Request method failure captured: Jul 28 03:59:41.890900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/os-volumes/52ff2bc8-efe0-468f-803e-970b3a4114ad HTTP/1.1 Jul 28 03:59:41.890900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 03:59:41.890900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 03:59:41.890900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 03:59:41.890900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 03:59:41.890900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 03:59:41.890900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 03:59:41.890900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 03:59:41.890900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 03:59:41.890900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gmdGux63KCB_3XTcVqaCMxqUP-jIX6bMhkbRC4S5f6w7yM6Od3OaUzpouoImV9nRIB0JD_2ivInYBzkujQtwn-bDuUjyjTSMIBNPmvSKEN8Pnns3CUrFCJas-c7FE5zQPDjKiin5uykyRASX4fM9E3N7dXEeKpGry2_qUJL6vD9bwA Jul 28 03:59:41.890900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 03:59:41.890900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 03:59:41.890900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 03:59:41.890900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 03:59:41.890900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 03:59:41.890900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 03:59:41.890900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 726a1ad14d374061a5db26470f86fdf7 Jul 28 03:59:41.890900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-996543154 Jul 28 03:59:41.890900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 03:59:41.890900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 03:59:41.892009 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_726a1ad14d374061a5db26470f86fdf7", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/726a1ad14d374061a5db26470f86fdf7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/726a1ad14d374061a5db26470f86fdf7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/726a1ad14d374061a5db26470f86fdf7"}]}] Jul 28 03:59:41.892009 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-VolumesSnapshotsTestJSON-996543154 Jul 28 03:59:41.892009 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 726a1ad14d374061a5db26470f86fdf7 Jul 28 03:59:41.892009 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-996543154 Jul 28 03:59:41.892009 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-VolumesSnapshotsTestJSON-996543154-project Jul 28 03:59:41.892009 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 03:59:41.892009 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 03:59:41.892009 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: 4dab551c284242df98e62efdc5de8de7 Jul 28 03:59:41.892009 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-VolumesSnapshotsTestJSON-996543154-project Jul 28 03:59:41.892009 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: Jul 28 03:59:41.892009 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Volume 52ff2bc8-efe0-468f-803e-970b3a4114ad could not be found. Jul 28 03:59:41.892009 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': '52ff2bc8-efe0-468f-803e-970b3a4114ad'} Jul 28 03:59:41.892009 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:59:41.893230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:41.893230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:59:41.893230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:59:41.893230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 03:59:41.893230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 03:59:41.893230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 03:59:41.893230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 03:59:41.893230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 03:59:41.893230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 03:59:41.893230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 03:59:41.893230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 03:59:41.893230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:59:41.893230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:59:41.893230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:59:41.893230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:59:41.893230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 52ff2bc8-efe0-468f-803e-970b3a4114ad could not be found. (HTTP 404) (Request-ID: req-8c7feaa8-15ac-440f-8354-4512d958823d) Jul 28 03:59:41.893230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:41.893230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:41.893230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:41.894108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:41.894108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 03:59:41.894108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 03:59:41.894108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 03:59:41.894108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 03:59:41.894108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 03:59:41.894108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 03:59:41.894108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 03:59:41.894108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 03:59:41.894108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:59:41.894108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:59:41.894108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 03:59:41.894108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 03:59:41.894108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 03:59:41.894108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 03:59:41.894108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 03:59:41.894108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 03:59:41.894108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 03:59:41.894108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 03:59:41.895047 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:59:41.895047 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:59:41.895047 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:59:41.895047 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:59:41.895047 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 52ff2bc8-efe0-468f-803e-970b3a4114ad could not be found. Jul 28 03:59:41.895047 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:41.895047 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:41.895047 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:41.895047 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:41.895047 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:41.895047 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:41.895047 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:59:41.895047 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:59:41.895047 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:59:41.895047 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:59:41.895047 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:59:41.895047 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:59:41.895047 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 03:59:41.895047 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:59:41.897628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 52ff2bc8-efe0-468f-803e-970b3a4114ad could not be found. Jul 28 03:59:41.897628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:41.897628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:41.897628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:41.897628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:41.897628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:41.897628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:41.897628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:59:41.897628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:59:41.897628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 52ff2bc8-efe0-468f-803e-970b3a4114ad could not be found. Jul 28 03:59:41.897628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:41.900214 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-28c3f541-d405-4f48-856f-4a4060d5a853 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] Returning 404 to user: Volume 52ff2bc8-efe0-468f-803e-970b3a4114ad could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:59:41.902360 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-28c3f541-d405-4f48-856f-4a4060d5a853 tempest-VolumesSnapshotsTestJSON-996543154 tempest-VolumesSnapshotsTestJSON-996543154-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/52ff2bc8-efe0-468f-803e-970b3a4114ad" status: 404 len: 109 microversion: 2.1 time: 0.382128 Jul 28 03:59:41.903714 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 12/20] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 03:59:41 2022] GET /compute/v2.1/os-volumes/52ff2bc8-efe0-468f-803e-970b3a4114ad => generated 109 bytes in 385 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:59:42.320835 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fcabab0c-3a00-4d28-8eb3-fd0eb5f909ba tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-825539013", "imageRef": "a0eec51c-83e9-420b-bcb9-20fe8dcf5321", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21c60ecd-c113-4857-a1b5-c85ec6a7053f"}], "security_groups": [{"name": "tempest-securitygroup--1920694896"}], "key_name": "tempest-keypair-1655261939", "user_data": "}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:42.723022 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.network.neutron [None req-fcabab0c-3a00-4d28-8eb3-fd0eb5f909ba tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] validate_networks() for [('21c60ecd-c113-4857-a1b5-c85ec6a7053f', None, None, None, None, None)] {{(pid=118187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:59:44.913870 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-fcabab0c-3a00-4d28-8eb3-fd0eb5f909ba tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Flavor limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:59:44.917063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-fcabab0c-3a00-4d28-8eb3-fd0eb5f909ba tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Image limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:59:44.917715 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-fcabab0c-3a00-4d28-8eb3-fd0eb5f909ba tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Flavor pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:59:44.918399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-fcabab0c-3a00-4d28-8eb3-fd0eb5f909ba tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Image pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:59:44.918998 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-fcabab0c-3a00-4d28-8eb3-fd0eb5f909ba tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:59:44.933233 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fcabab0c-3a00-4d28-8eb3-fd0eb5f909ba tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:44.937322 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fcabab0c-3a00-4d28-8eb3-fd0eb5f909ba tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:44.940007 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fcabab0c-3a00-4d28-8eb3-fd0eb5f909ba tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:44.945009 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fcabab0c-3a00-4d28-8eb3-fd0eb5f909ba tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:45.033640 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-fcabab0c-3a00-4d28-8eb3-fd0eb5f909ba tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Getting quotas for project 18a927e9f5da42d7b34752c8b2db211a. Resources: {'instances', 'cores', 'ram'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:59:45.056984 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-fcabab0c-3a00-4d28-8eb3-fd0eb5f909ba tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Getting quotas for user c3308761e9d2495e95e127bbc7b9c5e2 and project 18a927e9f5da42d7b34752c8b2db211a. Resources: {'instances', 'cores', 'ram'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:59:45.101414 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-fcabab0c-3a00-4d28-8eb3-fd0eb5f909ba tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Going to run 1 instances... {{(pid=118187) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:59:45.106131 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-fcabab0c-3a00-4d28-8eb3-fd0eb5f909ba tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0eec51c-83e9-420b-bcb9-20fe8dcf5321',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 03:59:45.109191 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-dfd4e054-0c52-4637-958b-d45315167889 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Flavor limits 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:59:45.109720 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-dfd4e054-0c52-4637-958b-d45315167889 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Image limits 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:59:45.110390 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-dfd4e054-0c52-4637-958b-d45315167889 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Flavor pref 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:59:45.111319 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-dfd4e054-0c52-4637-958b-d45315167889 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Image pref 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:59:45.111839 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-dfd4e054-0c52-4637-958b-d45315167889 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:59:45.146111 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dfd4e054-0c52-4637-958b-d45315167889 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:45.148333 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dfd4e054-0c52-4637-958b-d45315167889 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:45.152814 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dfd4e054-0c52-4637-958b-d45315167889 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:45.153418 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dfd4e054-0c52-4637-958b-d45315167889 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:45.228026 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-dfd4e054-0c52-4637-958b-d45315167889 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Getting quotas for project cb2697d81b164ddfbb33acd843f461f6. Resources: {'instances', 'cores', 'ram'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:59:45.258265 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-dfd4e054-0c52-4637-958b-d45315167889 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Getting quotas for user d09411d75019428a922e12e02c72f4af and project cb2697d81b164ddfbb33acd843f461f6. Resources: {'instances', 'cores', 'ram'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:59:45.280852 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-fcabab0c-3a00-4d28-8eb3-fd0eb5f909ba tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.966582 Jul 28 03:59:45.282894 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 13/21] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 03:59:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 2971 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:59:45.308831 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-dfd4e054-0c52-4637-958b-d45315167889 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Going to run 1 instances... {{(pid=118186) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:59:45.321172 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-dfd4e054-0c52-4637-958b-d45315167889 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0eec51c-83e9-420b-bcb9-20fe8dcf5321',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 03:59:45.579287 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-dfd4e054-0c52-4637-958b-d45315167889 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.909265 Jul 28 03:59:45.580504 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 9/22] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 03:59:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 5911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:59:45.585769 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-8f884bb9-b750-40cf-94c3-babc0980f80f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:45.596798 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-8f884bb9-b750-40cf-94c3-babc0980f80f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:45.875840 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-8f884bb9-b750-40cf-94c3-babc0980f80f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:45.894300 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-8f884bb9-b750-40cf-94c3-babc0980f80f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1241 microversion: 2.1 time: 0.312383 Jul 28 03:59:45.895159 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 10/23] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:45 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1241 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:45.911827 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-acf2805a-d12e-4e8a-8c29-a79abdf22405 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:45.916449 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-acf2805a-d12e-4e8a-8c29-a79abdf22405 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:45.982387 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-acf2805a-d12e-4e8a-8c29-a79abdf22405 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:46.008450 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-acf2805a-d12e-4e8a-8c29-a79abdf22405 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1215 microversion: 2.1 time: 0.111852 Jul 28 03:59:46.009389 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 11/24] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:45 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1215 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:46.049219 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-53b392bd-9cbd-4856-8069-df337fafb888 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Action: 'create', calling method: .version_select at 0x7fa6ef5e7280>, body: {"keypair": {"name": "tempest-keypair-852713893", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDbtozJjejrnwwe93eLOY4vZCjCR/LblwblWf+XeeXs4eZ5CuXaMTzLmm6UmpGf66Wmy2Ri7cwIfOjvGcfUHhkcVLEzKTRPyJueLS7q0yEUk+QU/xy601SUBLMCW0PjlWw=="}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:46.094558 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-53b392bd-9cbd-4856-8069-df337fafb888 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Getting quotas for project 5db0f08a14ac472fb3edf2107c9ccfc5. Resources: {'key_pairs'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:59:46.108939 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-53b392bd-9cbd-4856-8069-df337fafb888 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Getting quotas for user 7112379fb6794027a7c1519b2f77a5d4 and project 5db0f08a14ac472fb3edf2107c9ccfc5. Resources: {'key_pairs'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:59:46.165376 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-53b392bd-9cbd-4856-8069-df337fafb888 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.877071 Jul 28 03:59:46.167129 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 14/25] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 03:59:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 882 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:46.921722 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7e734d52-504e-4f41-8f53-a1feb2973997 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:46.923402 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7e734d52-504e-4f41-8f53-a1feb2973997 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:46.926736 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-e285ef3d-5162-4dc5-93a7-add278f355fd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-480978697", "imageRef": "a0eec51c-83e9-420b-bcb9-20fe8dcf5321", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:47.071538 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.network.neutron [None req-e285ef3d-5162-4dc5-93a7-add278f355fd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] validate_networks() for [('34f2eea8-1bb5-4a42-ad93-e6506b454025', None, None, None, None, None)] {{(pid=118186) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:59:47.130478 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7e734d52-504e-4f41-8f53-a1feb2973997 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:47.159680 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7e734d52-504e-4f41-8f53-a1feb2973997 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1241 microversion: 2.1 time: 0.240892 Jul 28 03:59:47.184243 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 15/26] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:46 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1241 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 03:59:47.192258 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4a9089db-d0ae-4a98-a47a-d5c1a69981aa tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:47.193374 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-4a9089db-d0ae-4a98-a47a-d5c1a69981aa tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:47.301324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4a9089db-d0ae-4a98-a47a-d5c1a69981aa tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:47.312081 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4a9089db-d0ae-4a98-a47a-d5c1a69981aa tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1215 microversion: 2.1 time: 0.126090 Jul 28 03:59:47.322635 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 16/27] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:47 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1215 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:47.819391 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c2f2b316-b5be-4b8f-bfa1-e6355de9042e tempest-VolumesGetTestJSON-503590950 tempest-VolumesGetTestJSON-503590950-project] Action: 'create', calling method: .version_select at 0x7fa6ee58c5e0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1583185375", "metadata": {"Type": "work"}}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:48.857675 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c2f2b316-b5be-4b8f-bfa1-e6355de9042e tempest-VolumesGetTestJSON-503590950 tempest-VolumesGetTestJSON-503590950-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.346484 Jul 28 03:59:48.858845 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 17/28] 10.222.0.46 () {60 vars in 1156 bytes} [Thu Jul 28 03:59:47 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 1349 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 28 03:59:48.871700 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-82a31fe6-083d-490c-a3c0-d948e8e21ac7 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:48.872484 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-82a31fe6-083d-490c-a3c0-d948e8e21ac7 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:48.892964 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-82a31fe6-083d-490c-a3c0-d948e8e21ac7 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:48.898250 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-82a31fe6-083d-490c-a3c0-d948e8e21ac7 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:48.918130 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-82a31fe6-083d-490c-a3c0-d948e8e21ac7 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:48.919633 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-82a31fe6-083d-490c-a3c0-d948e8e21ac7 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:49.153147 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-e285ef3d-5162-4dc5-93a7-add278f355fd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Flavor limits 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:59:49.154242 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-e285ef3d-5162-4dc5-93a7-add278f355fd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Image limits 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:59:49.155326 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-e285ef3d-5162-4dc5-93a7-add278f355fd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Flavor pref 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:59:49.155934 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-e285ef3d-5162-4dc5-93a7-add278f355fd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Image pref 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:59:49.156492 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-e285ef3d-5162-4dc5-93a7-add278f355fd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:59:49.205232 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e285ef3d-5162-4dc5-93a7-add278f355fd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:49.205827 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e285ef3d-5162-4dc5-93a7-add278f355fd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:49.206466 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e285ef3d-5162-4dc5-93a7-add278f355fd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:49.208182 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e285ef3d-5162-4dc5-93a7-add278f355fd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:49.290496 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-e285ef3d-5162-4dc5-93a7-add278f355fd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Getting quotas for project 6ca5212b1a1743f2910407d7b8ba7aaf. Resources: {'instances', 'cores', 'ram'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:59:49.308572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-e285ef3d-5162-4dc5-93a7-add278f355fd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Getting quotas for user 72dbbd19e4454bee84fe5bc797497bd0 and project 6ca5212b1a1743f2910407d7b8ba7aaf. Resources: {'instances', 'cores', 'ram'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:59:49.364485 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-e285ef3d-5162-4dc5-93a7-add278f355fd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Going to run 1 instances... {{(pid=118186) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:59:49.366927 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-e285ef3d-5162-4dc5-93a7-add278f355fd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0eec51c-83e9-420b-bcb9-20fe8dcf5321',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 03:59:49.370325 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-82a31fe6-083d-490c-a3c0-d948e8e21ac7 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:49.410314 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-82a31fe6-083d-490c-a3c0-d948e8e21ac7 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1245 microversion: 2.1 time: 0.549851 Jul 28 03:59:49.414834 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 18/29] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:48 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1245 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:49.431793 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9a483588-7d9d-4bf8-8445-ab562c9da5ca tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:49.432430 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9a483588-7d9d-4bf8-8445-ab562c9da5ca tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:49.515519 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9a483588-7d9d-4bf8-8445-ab562c9da5ca tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:49.522322 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-e285ef3d-5162-4dc5-93a7-add278f355fd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.281616 Jul 28 03:59:49.533400 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9a483588-7d9d-4bf8-8445-ab562c9da5ca tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:49.537147 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9a483588-7d9d-4bf8-8445-ab562c9da5ca tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:49.545817 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9a483588-7d9d-4bf8-8445-ab562c9da5ca tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:49.564648 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 12/30] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 03:59:46 2022] POST /compute/v2.1/servers => generated 383 bytes in 3325 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:59:49.593953 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-da4592b1-ab59-40e0-bd17-71537647fc3f tempest-VolumesGetTestJSON-503590950 tempest-VolumesGetTestJSON-503590950-project] Calling method '.version_select at 0x7fa6eee12280>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:49.703060 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-da4592b1-ab59-40e0-bd17-71537647fc3f tempest-VolumesGetTestJSON-503590950 tempest-VolumesGetTestJSON-503590950-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ed29e7b8-25f0-4804-8acb-9b5213b87a5e" status: 200 len: 354 microversion: 2.1 time: 0.132550 Jul 28 03:59:49.712299 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 13/31] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 03:59:49 2022] GET /compute/v2.1/os-volumes/ed29e7b8-25f0-4804-8acb-9b5213b87a5e => generated 354 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:49.719455 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-0c69371e-368c-4704-8b54-72b1365fc972 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:49.721394 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-0c69371e-368c-4704-8b54-72b1365fc972 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:49.959312 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-0c69371e-368c-4704-8b54-72b1365fc972 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:49.973977 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-0c69371e-368c-4704-8b54-72b1365fc972 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1221 microversion: 2.1 time: 0.256379 Jul 28 03:59:49.978231 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9a483588-7d9d-4bf8-8445-ab562c9da5ca tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:49.980840 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 14/32] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:49 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1221 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:49.991332 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9a483588-7d9d-4bf8-8445-ab562c9da5ca tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1267 microversion: 2.1 time: 0.572278 Jul 28 03:59:49.999130 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-0e111351-72e5-47f9-894e-a6490c72db84 tempest-VolumesGetTestJSON-503590950 tempest-VolumesGetTestJSON-503590950-project] Calling method '.version_select at 0x7fa6efe4cdc0>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:50.008406 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 19/33] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:49 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1267 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:50.080631 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-0e111351-72e5-47f9-894e-a6490c72db84 tempest-VolumesGetTestJSON-503590950 tempest-VolumesGetTestJSON-503590950-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ed29e7b8-25f0-4804-8acb-9b5213b87a5e" status: 200 len: 354 microversion: 2.1 time: 0.095284 Jul 28 03:59:50.092833 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 15/34] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 03:59:49 2022] GET /compute/v2.1/os-volumes/ed29e7b8-25f0-4804-8acb-9b5213b87a5e => generated 354 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:50.098733 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e37e419d-99d0-4dca-8fe3-381da701e081 tempest-VolumesGetTestJSON-503590950 tempest-VolumesGetTestJSON-503590950-project] Calling method '.version_select at 0x7fa6ee51f5e0>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:50.301113 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e37e419d-99d0-4dca-8fe3-381da701e081 tempest-VolumesGetTestJSON-503590950 tempest-VolumesGetTestJSON-503590950-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/ed29e7b8-25f0-4804-8acb-9b5213b87a5e" status: 202 len: 0 microversion: 2.1 time: 0.207552 Jul 28 03:59:50.301804 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 20/35] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Jul 28 03:59:50 2022] DELETE /compute/v2.1/os-volumes/ed29e7b8-25f0-4804-8acb-9b5213b87a5e => generated 0 bytes in 209 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 03:59:50.318574 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-4b639ab0-4b6a-45c8-a508-443c159805ae tempest-VolumesGetTestJSON-503590950 tempest-VolumesGetTestJSON-503590950-project] Calling method '.version_select at 0x7fa6eee12d30>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:50.346980 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a2e8e729-58f8-4c56-b306-2035c4c61c0c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-993633227", "imageRef": "a0eec51c-83e9-420b-bcb9-20fe8dcf5321", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:50.450640 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-4b639ab0-4b6a-45c8-a508-443c159805ae tempest-VolumesGetTestJSON-503590950 tempest-VolumesGetTestJSON-503590950-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ed29e7b8-25f0-4804-8acb-9b5213b87a5e" status: 200 len: 353 microversion: 2.1 time: 0.140721 Jul 28 03:59:50.451714 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 16/36] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 03:59:50 2022] GET /compute/v2.1/os-volumes/ed29e7b8-25f0-4804-8acb-9b5213b87a5e => generated 353 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:50.462473 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c84f0564-720c-496e-8882-9ceaa879b770 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:50.465432 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c84f0564-720c-496e-8882-9ceaa879b770 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:50.490520 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c84f0564-720c-496e-8882-9ceaa879b770 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:50.492024 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c84f0564-720c-496e-8882-9ceaa879b770 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:50.495277 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c84f0564-720c-496e-8882-9ceaa879b770 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:50.495999 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c84f0564-720c-496e-8882-9ceaa879b770 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:50.539035 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.network.neutron [None req-a2e8e729-58f8-4c56-b306-2035c4c61c0c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] validate_networks() for [('34f2eea8-1bb5-4a42-ad93-e6506b454025', None, None, None, None, None)] {{(pid=118187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:59:51.072537 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-c84f0564-720c-496e-8882-9ceaa879b770 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:51.095837 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-c84f0564-720c-496e-8882-9ceaa879b770 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1301 microversion: 2.1 time: 0.641603 Jul 28 03:59:51.097856 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 17/37] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:50 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1301 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:51.121222 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-95cf6af8-1c52-4494-8a42-8a0089330d46 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-47660709", "imageRef": "a0eec51c-83e9-420b-bcb9-20fe8dcf5321", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ddbc06c5-f1b9-4080-a226-5763d344d779"}], "security_groups": [{"name": "tempest-securitygroup--1795803587"}], "key_name": "tempest-keypair-852713893", "user_data": "}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:51.400521 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.network.neutron [None req-95cf6af8-1c52-4494-8a42-8a0089330d46 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] validate_networks() for [('ddbc06c5-f1b9-4080-a226-5763d344d779', None, None, None, None, None)] {{(pid=118186) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 03:59:51.552398 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-a2e8e729-58f8-4c56-b306-2035c4c61c0c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Flavor limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:59:51.553583 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-a2e8e729-58f8-4c56-b306-2035c4c61c0c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Image limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:59:51.554439 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-a2e8e729-58f8-4c56-b306-2035c4c61c0c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Flavor pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:59:51.555145 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-a2e8e729-58f8-4c56-b306-2035c4c61c0c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Image pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:59:51.555770 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-a2e8e729-58f8-4c56-b306-2035c4c61c0c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:59:51.569306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a2e8e729-58f8-4c56-b306-2035c4c61c0c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:51.570573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a2e8e729-58f8-4c56-b306-2035c4c61c0c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:51.571452 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a2e8e729-58f8-4c56-b306-2035c4c61c0c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:51.571900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a2e8e729-58f8-4c56-b306-2035c4c61c0c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:51.601189 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-a2e8e729-58f8-4c56-b306-2035c4c61c0c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Getting quotas for project 6ca5212b1a1743f2910407d7b8ba7aaf. Resources: {'instances', 'cores', 'ram'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:59:51.606383 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-a2e8e729-58f8-4c56-b306-2035c4c61c0c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Getting quotas for user 72dbbd19e4454bee84fe5bc797497bd0 and project 6ca5212b1a1743f2910407d7b8ba7aaf. Resources: {'instances', 'cores', 'ram'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:59:51.624444 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a2e8e729-58f8-4c56-b306-2035c4c61c0c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Going to run 1 instances... {{(pid=118187) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:59:51.628294 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a2e8e729-58f8-4c56-b306-2035c4c61c0c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0eec51c-83e9-420b-bcb9-20fe8dcf5321',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 03:59:51.697075 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a2e8e729-58f8-4c56-b306-2035c4c61c0c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.358077 Jul 28 03:59:51.698349 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 21/38] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 03:59:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 1360 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:59:51.707238 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-126dab70-d477-4c82-b9a5-0f74044542d0 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:51.708129 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-126dab70-d477-4c82-b9a5-0f74044542d0 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:51.716057 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-126dab70-d477-4c82-b9a5-0f74044542d0 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:51.717442 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-126dab70-d477-4c82-b9a5-0f74044542d0 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:51.718635 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-126dab70-d477-4c82-b9a5-0f74044542d0 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:51.719425 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-126dab70-d477-4c82-b9a5-0f74044542d0 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:51.821168 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-126dab70-d477-4c82-b9a5-0f74044542d0 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:51.836138 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-126dab70-d477-4c82-b9a5-0f74044542d0 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1273 microversion: 2.1 time: 0.136013 Jul 28 03:59:51.837898 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 22/39] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:51 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1273 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:51.852122 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-22f8605a-39b0-43c7-88d2-1f1b11f7e1fa tempest-VolumesGetTestJSON-503590950 tempest-VolumesGetTestJSON-503590950-project] Calling method '.version_select at 0x7fa6ee51fca0>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:51.921272 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-22f8605a-39b0-43c7-88d2-1f1b11f7e1fa tempest-VolumesGetTestJSON-503590950 tempest-VolumesGetTestJSON-503590950-project] HTTP exception thrown: Volume ed29e7b8-25f0-4804-8acb-9b5213b87a5e could not be found. Jul 28 03:59:51.924157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-22f8605a-39b0-43c7-88d2-1f1b11f7e1fa tempest-VolumesGetTestJSON-503590950 tempest-VolumesGetTestJSON-503590950-project] Request method failure captured: Jul 28 03:59:51.924157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/os-volumes/ed29e7b8-25f0-4804-8acb-9b5213b87a5e HTTP/1.1 Jul 28 03:59:51.924157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 03:59:51.924157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 03:59:51.924157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 03:59:51.924157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 03:59:51.924157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 03:59:51.924157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 03:59:51.924157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 03:59:51.924157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 03:59:51.924157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gmzlWS4ucoYcsF9Byy91wkZ4lli1BSfpzNpsp-4T5fSgy5w40yK6lLzqgs8XE35c0A3c69j7MqH8NfwHM5DaRUIklKr79Bo8VlfqiRBLAhbaE35PRgWxKghLVydmx9Unq65dcJe3H64KbYg3MRA1RuCTMBngYaY3Ip3joATMVURYWA Jul 28 03:59:51.924157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 03:59:51.924157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 03:59:51.924157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 03:59:51.924157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 03:59:51.924157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 03:59:51.924157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 03:59:51.924157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: c4082865fb164d39ba7257b5fd308ab5 Jul 28 03:59:51.924157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-VolumesGetTestJSON-503590950 Jul 28 03:59:51.924157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 03:59:51.924157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 03:59:51.925513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c4082865fb164d39ba7257b5fd308ab5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c4082865fb164d39ba7257b5fd308ab5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c4082865fb164d39ba7257b5fd308ab5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c4082865fb164d39ba7257b5fd308ab5"}]}] Jul 28 03:59:51.925513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-VolumesGetTestJSON-503590950 Jul 28 03:59:51.925513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: c4082865fb164d39ba7257b5fd308ab5 Jul 28 03:59:51.925513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-VolumesGetTestJSON-503590950 Jul 28 03:59:51.925513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-VolumesGetTestJSON-503590950-project Jul 28 03:59:51.925513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 03:59:51.925513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 03:59:51.925513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: 0bf42d8e1df64661af5fb0f286df8881 Jul 28 03:59:51.925513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-VolumesGetTestJSON-503590950-project Jul 28 03:59:51.925513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: Jul 28 03:59:51.925513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Volume ed29e7b8-25f0-4804-8acb-9b5213b87a5e could not be found. Jul 28 03:59:51.925513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': 'ed29e7b8-25f0-4804-8acb-9b5213b87a5e'} Jul 28 03:59:51.925513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:59:51.926369 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:51.926369 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:59:51.926369 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:59:51.926369 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 03:59:51.926369 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 03:59:51.926369 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 03:59:51.926369 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 03:59:51.926369 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 03:59:51.926369 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 03:59:51.926369 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 03:59:51.926369 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 03:59:51.926369 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:59:51.926369 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:59:51.926369 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:59:51.926369 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:59:51.926369 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ed29e7b8-25f0-4804-8acb-9b5213b87a5e could not be found. (HTTP 404) (Request-ID: req-e8efe97c-2cf2-4679-80c0-6ad602f3f5bb) Jul 28 03:59:51.926369 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:51.926369 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:51.926369 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:51.927538 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:51.927538 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 03:59:51.927538 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 03:59:51.927538 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 03:59:51.927538 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 03:59:51.927538 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 03:59:51.927538 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 03:59:51.927538 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 03:59:51.927538 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 03:59:51.927538 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:59:51.927538 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:59:51.927538 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 03:59:51.927538 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 03:59:51.927538 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 03:59:51.927538 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 03:59:51.927538 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 03:59:51.927538 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 03:59:51.927538 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 03:59:51.927538 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 03:59:51.928913 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:59:51.928913 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:59:51.928913 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:59:51.928913 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:59:51.928913 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ed29e7b8-25f0-4804-8acb-9b5213b87a5e could not be found. Jul 28 03:59:51.928913 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:51.928913 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:51.928913 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:51.928913 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:51.928913 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:51.928913 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:51.928913 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:59:51.928913 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:59:51.928913 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:59:51.928913 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:59:51.928913 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:59:51.928913 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:59:51.928913 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 03:59:51.928913 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:59:51.930032 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ed29e7b8-25f0-4804-8acb-9b5213b87a5e could not be found. Jul 28 03:59:51.930032 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:51.930032 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:51.930032 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:51.930032 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:51.930032 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:51.930032 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:51.930032 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:59:51.930032 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:59:51.930032 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ed29e7b8-25f0-4804-8acb-9b5213b87a5e could not be found. Jul 28 03:59:51.930032 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:51.930032 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-22f8605a-39b0-43c7-88d2-1f1b11f7e1fa tempest-VolumesGetTestJSON-503590950 tempest-VolumesGetTestJSON-503590950-project] Returning 404 to user: Volume ed29e7b8-25f0-4804-8acb-9b5213b87a5e could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:59:51.930032 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-22f8605a-39b0-43c7-88d2-1f1b11f7e1fa tempest-VolumesGetTestJSON-503590950 tempest-VolumesGetTestJSON-503590950-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/ed29e7b8-25f0-4804-8acb-9b5213b87a5e" status: 404 len: 109 microversion: 2.1 time: 0.087679 Jul 28 03:59:51.930032 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 23/40] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 03:59:51 2022] GET /compute/v2.1/os-volumes/ed29e7b8-25f0-4804-8acb-9b5213b87a5e => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 03:59:51.942766 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ad9b55d7-1030-487d-9909-91b3eb45ed52 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:51.946412 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ad9b55d7-1030-487d-9909-91b3eb45ed52 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:52.483638 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ad9b55d7-1030-487d-9909-91b3eb45ed52 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:52.499823 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ad9b55d7-1030-487d-9909-91b3eb45ed52 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1221 microversion: 2.1 time: 0.570274 Jul 28 03:59:52.518272 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 24/41] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:51 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1221 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:52.536887 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a389b5eb-625d-4e3d-802c-dc21cc5cb6b1 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:52.543847 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a389b5eb-625d-4e3d-802c-dc21cc5cb6b1 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:52.571283 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a389b5eb-625d-4e3d-802c-dc21cc5cb6b1 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:52.572986 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a389b5eb-625d-4e3d-802c-dc21cc5cb6b1 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:52.579340 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a389b5eb-625d-4e3d-802c-dc21cc5cb6b1 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:52.579803 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a389b5eb-625d-4e3d-802c-dc21cc5cb6b1 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:52.959577 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a389b5eb-625d-4e3d-802c-dc21cc5cb6b1 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:52.989228 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a389b5eb-625d-4e3d-802c-dc21cc5cb6b1 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1299 microversion: 2.1 time: 0.463283 Jul 28 03:59:52.993988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 25/42] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:52 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1299 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:53.021561 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2c35ba04-3c6f-413a-8092-d4251e28b06b tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:53.032954 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-2c35ba04-3c6f-413a-8092-d4251e28b06b tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:53.072275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2c35ba04-3c6f-413a-8092-d4251e28b06b tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:53.076802 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2c35ba04-3c6f-413a-8092-d4251e28b06b tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:53.084788 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2c35ba04-3c6f-413a-8092-d4251e28b06b tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:53.087783 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2c35ba04-3c6f-413a-8092-d4251e28b06b tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:53.542865 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-2c35ba04-3c6f-413a-8092-d4251e28b06b tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:53.558104 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-2c35ba04-3c6f-413a-8092-d4251e28b06b tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1273 microversion: 2.1 time: 0.558274 Jul 28 03:59:53.559881 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 26/43] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:52 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1273 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:53.596383 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3adbbf07-cc39-4de7-a21f-96b5507342b3 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:53.599118 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3adbbf07-cc39-4de7-a21f-96b5507342b3 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:53.612399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3adbbf07-cc39-4de7-a21f-96b5507342b3 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:53.612917 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3adbbf07-cc39-4de7-a21f-96b5507342b3 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:53.614376 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3adbbf07-cc39-4de7-a21f-96b5507342b3 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:53.616788 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3adbbf07-cc39-4de7-a21f-96b5507342b3 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:54.102159 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3adbbf07-cc39-4de7-a21f-96b5507342b3 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:54.110319 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3adbbf07-cc39-4de7-a21f-96b5507342b3 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1217 microversion: 2.1 time: 0.549331 Jul 28 03:59:54.127184 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 27/44] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:53 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1217 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:54.133908 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-61a9e87d-2a8d-4a50-82d8-3dfc0b3f9760 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:54.135034 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-61a9e87d-2a8d-4a50-82d8-3dfc0b3f9760 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:54.142715 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-61a9e87d-2a8d-4a50-82d8-3dfc0b3f9760 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:54.143611 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-61a9e87d-2a8d-4a50-82d8-3dfc0b3f9760 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:54.144614 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-61a9e87d-2a8d-4a50-82d8-3dfc0b3f9760 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:54.145267 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-61a9e87d-2a8d-4a50-82d8-3dfc0b3f9760 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:54.892910 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-61a9e87d-2a8d-4a50-82d8-3dfc0b3f9760 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:54.913357 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-61a9e87d-2a8d-4a50-82d8-3dfc0b3f9760 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1299 microversion: 2.1 time: 0.784210 Jul 28 03:59:54.915120 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 28/45] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:54 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1299 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:54.935669 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d0a63d59-b299-49a5-a627-9fbf243afe48 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:54.936508 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d0a63d59-b299-49a5-a627-9fbf243afe48 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:54.951724 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d0a63d59-b299-49a5-a627-9fbf243afe48 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:54.958057 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d0a63d59-b299-49a5-a627-9fbf243afe48 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:54.959215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d0a63d59-b299-49a5-a627-9fbf243afe48 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:54.959852 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d0a63d59-b299-49a5-a627-9fbf243afe48 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:55.166127 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-95cf6af8-1c52-4494-8a42-8a0089330d46 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Flavor limits 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 03:59:55.166698 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-95cf6af8-1c52-4494-8a42-8a0089330d46 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Image limits 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 03:59:55.167272 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-95cf6af8-1c52-4494-8a42-8a0089330d46 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Flavor pref 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 03:59:55.167770 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-95cf6af8-1c52-4494-8a42-8a0089330d46 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Image pref 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 03:59:55.168423 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-95cf6af8-1c52-4494-8a42-8a0089330d46 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 03:59:55.187378 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-95cf6af8-1c52-4494-8a42-8a0089330d46 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:55.188247 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-95cf6af8-1c52-4494-8a42-8a0089330d46 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:55.190330 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-95cf6af8-1c52-4494-8a42-8a0089330d46 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:55.196068 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-95cf6af8-1c52-4494-8a42-8a0089330d46 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:55.270413 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-95cf6af8-1c52-4494-8a42-8a0089330d46 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Getting quotas for project 5db0f08a14ac472fb3edf2107c9ccfc5. Resources: {'instances', 'cores', 'ram'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 03:59:55.283094 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-95cf6af8-1c52-4494-8a42-8a0089330d46 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Getting quotas for user 7112379fb6794027a7c1519b2f77a5d4 and project 5db0f08a14ac472fb3edf2107c9ccfc5. Resources: {'instances', 'cores', 'ram'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 03:59:55.345716 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-95cf6af8-1c52-4494-8a42-8a0089330d46 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Going to run 1 instances... {{(pid=118186) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 03:59:55.356845 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-95cf6af8-1c52-4494-8a42-8a0089330d46 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0eec51c-83e9-420b-bcb9-20fe8dcf5321',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 03:59:55.524626 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-95cf6af8-1c52-4494-8a42-8a0089330d46 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.423242 Jul 28 03:59:55.527360 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 18/46] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 03:59:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 4429 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 03:59:55.545947 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-8dedf2ec-2412-44f4-b8ed-d6c0c8621e94 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:55.562291 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-8dedf2ec-2412-44f4-b8ed-d6c0c8621e94 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:55.588725 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8dedf2ec-2412-44f4-b8ed-d6c0c8621e94 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:55.589547 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8dedf2ec-2412-44f4-b8ed-d6c0c8621e94 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:55.590658 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8dedf2ec-2412-44f4-b8ed-d6c0c8621e94 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:55.594730 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8dedf2ec-2412-44f4-b8ed-d6c0c8621e94 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:56.269292 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d0a63d59-b299-49a5-a627-9fbf243afe48 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:56.279887 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d0a63d59-b299-49a5-a627-9fbf243afe48 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1315 microversion: 2.1 time: 1.358906 Jul 28 03:59:56.283482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 29/47] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:54 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1315 bytes in 1367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:56.302416 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-31fa5629-7a7b-43b7-9f81-d9a13943a20c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:56.304371 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-31fa5629-7a7b-43b7-9f81-d9a13943a20c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:56.450640 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-8dedf2ec-2412-44f4-b8ed-d6c0c8621e94 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:56.467845 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-8dedf2ec-2412-44f4-b8ed-d6c0c8621e94 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1279 microversion: 2.1 time: 0.937272 Jul 28 03:59:56.488038 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 19/48] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:55 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1279 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:56.503077 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-44e91c40-058c-4ed7-979d-7eda51dd1a16 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:56.503824 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-44e91c40-058c-4ed7-979d-7eda51dd1a16 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:56.520903 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-44e91c40-058c-4ed7-979d-7eda51dd1a16 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:56.521730 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-44e91c40-058c-4ed7-979d-7eda51dd1a16 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:56.525539 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-44e91c40-058c-4ed7-979d-7eda51dd1a16 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:56.528220 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-44e91c40-058c-4ed7-979d-7eda51dd1a16 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:56.617849 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-31fa5629-7a7b-43b7-9f81-d9a13943a20c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:56.630450 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-31fa5629-7a7b-43b7-9f81-d9a13943a20c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1235 microversion: 2.1 time: 0.344455 Jul 28 03:59:56.636065 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 30/49] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:56 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1235 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:57.319715 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b3af6648-5c83-4f17-9f93-9c26c8ed66e1 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:57.321762 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b3af6648-5c83-4f17-9f93-9c26c8ed66e1 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:57.339672 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b3af6648-5c83-4f17-9f93-9c26c8ed66e1 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:57.341768 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b3af6648-5c83-4f17-9f93-9c26c8ed66e1 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:57.344486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b3af6648-5c83-4f17-9f93-9c26c8ed66e1 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:57.347948 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b3af6648-5c83-4f17-9f93-9c26c8ed66e1 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:58.551922 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-44e91c40-058c-4ed7-979d-7eda51dd1a16 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:58.568835 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-44e91c40-058c-4ed7-979d-7eda51dd1a16 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1367 microversion: 2.1 time: 2.078703 Jul 28 03:59:58.577428 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 20/50] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:56 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1367 bytes in 2088 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:58.592998 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-f393320f-d329-461a-853e-d7070ccf9d36 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:58.593625 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-f393320f-d329-461a-853e-d7070ccf9d36 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:58.614294 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f393320f-d329-461a-853e-d7070ccf9d36 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:58.614742 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f393320f-d329-461a-853e-d7070ccf9d36 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:58.636301 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f393320f-d329-461a-853e-d7070ccf9d36 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:58.638582 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f393320f-d329-461a-853e-d7070ccf9d36 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:58.644013 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b3af6648-5c83-4f17-9f93-9c26c8ed66e1 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:58.675555 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b3af6648-5c83-4f17-9f93-9c26c8ed66e1 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1315 microversion: 2.1 time: 1.371302 Jul 28 03:59:58.693893 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 31/51] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:57 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1315 bytes in 1394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:58.721688 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-0ce965d6-313c-40dc-a2e3-1f889b7f9021 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:58.723969 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-0ce965d6-313c-40dc-a2e3-1f889b7f9021 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:58.754872 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0ce965d6-313c-40dc-a2e3-1f889b7f9021 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:58.755242 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0ce965d6-313c-40dc-a2e3-1f889b7f9021 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:58.760238 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0ce965d6-313c-40dc-a2e3-1f889b7f9021 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:58.763062 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0ce965d6-313c-40dc-a2e3-1f889b7f9021 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:58.973335 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-0ce965d6-313c-40dc-a2e3-1f889b7f9021 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:58.988298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-0ce965d6-313c-40dc-a2e3-1f889b7f9021 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1287 microversion: 2.1 time: 0.292895 Jul 28 03:59:59.003251 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 32/52] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:58 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1287 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:59.179610 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-f393320f-d329-461a-853e-d7070ccf9d36 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:59.188480 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-f393320f-d329-461a-853e-d7070ccf9d36 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1279 microversion: 2.1 time: 0.609736 Jul 28 03:59:59.192860 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 21/53] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:58 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1279 bytes in 615 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:59.635878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-94d01d40-2c1d-48f8-ace2-8ce54614be1d tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] Action: 'create', calling method: .version_select at 0x7fa6ee51f820>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1662203718", "metadata": {"Type": "work"}}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:59.640742 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-94d01d40-2c1d-48f8-ace2-8ce54614be1d tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] Request method failure captured: Jul 28 03:59:59.640742 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 03:59:59.640742 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 03:59:59.640742 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 03:59:59.640742 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 03:59:59.640742 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 122 Jul 28 03:59:59.640742 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 03:59:59.640742 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 03:59:59.640742 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 03:59:59.640742 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 03:59:59.640742 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gm_xpiQ2vIVEUP3kEtsaxjAFMgRWEhzK6u231u6I1tmaT0Df4lH2GBjkQ1AgYuOGX-FCN97up5_CHaab72V03Spi1GVVFcM1AMV3HZfma1l312kHM3hUusTuLXEqFSCrScXHg6EKzhPEKP-_VWbu2Jq9kGFpsS869e6s2eWE2Op53A Jul 28 03:59:59.640742 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 03:59:59.640742 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 03:59:59.640742 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 03:59:59.640742 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 03:59:59.640742 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 03:59:59.640742 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 03:59:59.640742 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 7e4806116406458e83556bc47ae0a506 Jul 28 03:59:59.640742 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-VolumesNegativeTest-1637051493 Jul 28 03:59:59.640742 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 03:59:59.640742 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 03:59:59.642698 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e4806116406458e83556bc47ae0a506", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e4806116406458e83556bc47ae0a506"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e4806116406458e83556bc47ae0a506"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e4806116406458e83556bc47ae0a506"}]}] Jul 28 03:59:59.642698 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-VolumesNegativeTest-1637051493 Jul 28 03:59:59.642698 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 7e4806116406458e83556bc47ae0a506 Jul 28 03:59:59.642698 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-VolumesNegativeTest-1637051493 Jul 28 03:59:59.642698 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-VolumesNegativeTest-1637051493-project Jul 28 03:59:59.642698 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 03:59:59.642698 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 03:59:59.642698 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: ce9adf52bd924ccc8e2c994b76914739 Jul 28 03:59:59.642698 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-VolumesNegativeTest-1637051493-project Jul 28 03:59:59.642698 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Jul 28 03:59:59.642698 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1662203718", "metadata": {"Type": "work"}}} Jul 28 03:59:59.642698 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: Jul 28 03:59:59.642698 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 03:59:59.643566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1662203718', 'metadata': {'Type': 'work'}}}} Jul 28 03:59:59.643566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:59:59.643566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:59.643566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:59:59.643566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:59:59.643566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:59:59.643566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:59:59.643566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 28 03:59:59.643566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.643566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 03:59:59.643566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 03:59:59.643566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.643566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 03:59:59.643566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi '#$%' Jul 28 03:59:59.643566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.643566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:59.643566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.643566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:59.643566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:59.643566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:59.643566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:59:59.643566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:59:59.645218 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:59:59.645218 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:59:59.645218 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:59:59.645218 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:59:59.645218 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:59:59.645218 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:59:59.645218 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:59:59.645218 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:59:59.645218 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:59:59.645218 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:59:59.645218 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 03:59:59.645218 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.645218 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:59.645218 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.645218 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:59.645218 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:59.645218 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:59.645218 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:59:59.645218 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:59:59.646212 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 28 03:59:59.646212 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.648222 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-94d01d40-2c1d-48f8-ace2-8ce54614be1d tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:59:59.649322 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-94d01d40-2c1d-48f8-ace2-8ce54614be1d tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.279310 Jul 28 03:59:59.650472 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 33/54] 10.222.0.46 () {60 vars in 1156 bytes} [Thu Jul 28 03:59:59 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 281 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:59:59.655819 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b1b04556-e4c6-4741-97d8-bb704ec69484 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:59.662950 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-74a55432-3692-4d53-a742-0cf7ec28d3a2 req-54f1e482-758c-4a2d-b127-ec511fef7752 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54fdcaaa-031e-4509-b8a7-6b284460c7d2", "tag": "a3fa56f4-0f47-422c-8d08-1b8073aa9acc"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:59.669412 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b1b04556-e4c6-4741-97d8-bb704ec69484 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:59.683212 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b1b04556-e4c6-4741-97d8-bb704ec69484 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:59.686243 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b1b04556-e4c6-4741-97d8-bb704ec69484 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:59.687377 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b1b04556-e4c6-4741-97d8-bb704ec69484 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:59.688027 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b1b04556-e4c6-4741-97d8-bb704ec69484 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:59.697069 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-74a55432-3692-4d53-a742-0cf7ec28d3a2 req-54f1e482-758c-4a2d-b127-ec511fef7752 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:59.697882 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-74a55432-3692-4d53-a742-0cf7ec28d3a2 req-54f1e482-758c-4a2d-b127-ec511fef7752 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:59.726062 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-74a55432-3692-4d53-a742-0cf7ec28d3a2 req-54f1e482-758c-4a2d-b127-ec511fef7752 service nova] Creating event network-changed:a3fa56f4-0f47-422c-8d08-1b8073aa9acc for instance 54fdcaaa-031e-4509-b8a7-6b284460c7d2 on hv-cinder-79987 Jul 28 03:59:59.727070 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-74a55432-3692-4d53-a742-0cf7ec28d3a2 req-54f1e482-758c-4a2d-b127-ec511fef7752 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118186) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 03:59:59.728558 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7988404d-5465-4f90-a126-176651d54405 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:59.729345 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7988404d-5465-4f90-a126-176651d54405 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:59.730876 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7988404d-5465-4f90-a126-176651d54405 None None] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:59.731617 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7988404d-5465-4f90-a126-176651d54405 None None] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:59.743201 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.compute.rpcapi [None req-7988404d-5465-4f90-a126-176651d54405 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 03:59:59.744445 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7988404d-5465-4f90-a126-176651d54405 None None] Releasing lock "compute-rpcapi-router" {{(pid=118186) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 03:59:59.769183 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-7988404d-5465-4f90-a126-176651d54405 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181278 Jul 28 03:59:59.770024 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 22/55] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 03:59:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 03:59:59.776424 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a15c046b-e7e5-4c92-ad47-f483b68871f9 tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] Action: 'create', calling method: .version_select at 0x7fa6eecee700>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2137696882", "metadata": {"Type": "work"}}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:59.784416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a15c046b-e7e5-4c92-ad47-f483b68871f9 tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] Request method failure captured: Jul 28 03:59:59.784416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 03:59:59.784416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept: application/json Jul 28 03:59:59.784416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept-Encoding: identity Jul 28 03:59:59.784416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Connection: close Jul 28 03:59:59.784416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Length: 120 Jul 28 03:59:59.784416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Type: application/json Jul 28 03:59:59.784416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Host: 10.222.0.46 Jul 28 03:59:59.784416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Openstack-System-Scope: None Jul 28 03:59:59.784416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: User-Agent: python-urllib3/1.26.10 Jul 28 03:59:59.784416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Auth-Token: gAAAAABi4gm_xpiQ2vIVEUP3kEtsaxjAFMgRWEhzK6u231u6I1tmaT0Df4lH2GBjkQ1AgYuOGX-FCN97up5_CHaab72V03Spi1GVVFcM1AMV3HZfma1l312kHM3hUusTuLXEqFSCrScXHg6EKzhPEKP-_VWbu2Jq9kGFpsS869e6s2eWE2Op53A Jul 28 03:59:59.784416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Id: None Jul 28 03:59:59.784416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Name: None Jul 28 03:59:59.784416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Identity-Status: Confirmed Jul 28 03:59:59.784416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Is-Admin-Project: True Jul 28 03:59:59.784416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Id: default Jul 28 03:59:59.784416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Name: Default Jul 28 03:59:59.784416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Id: 7e4806116406458e83556bc47ae0a506 Jul 28 03:59:59.784416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Name: tempest-VolumesNegativeTest-1637051493 Jul 28 03:59:59.784416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Role: reader,member Jul 28 03:59:59.784416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Roles: reader,member Jul 28 03:59:59.785595 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e4806116406458e83556bc47ae0a506", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e4806116406458e83556bc47ae0a506"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e4806116406458e83556bc47ae0a506"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e4806116406458e83556bc47ae0a506"}]}] Jul 28 03:59:59.785595 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant: tempest-VolumesNegativeTest-1637051493 Jul 28 03:59:59.785595 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Id: 7e4806116406458e83556bc47ae0a506 Jul 28 03:59:59.785595 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Name: tempest-VolumesNegativeTest-1637051493 Jul 28 03:59:59.785595 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User: tempest-VolumesNegativeTest-1637051493-project Jul 28 03:59:59.785595 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Id: default Jul 28 03:59:59.785595 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Name: Default Jul 28 03:59:59.785595 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Id: ce9adf52bd924ccc8e2c994b76914739 Jul 28 03:59:59.785595 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Name: tempest-VolumesNegativeTest-1637051493-project Jul 28 03:59:59.785595 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Jul 28 03:59:59.785595 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2137696882", "metadata": {"Type": "work"}}} Jul 28 03:59:59.785595 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: method: Jul 28 03:59:59.785595 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 03:59:59.786233 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2137696882', 'metadata': {'Type': 'work'}}}} Jul 28 03:59:59.786233 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:59:59.786233 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:59.786233 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:59:59.786233 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:59:59.786233 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:59:59.786233 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:59:59.786233 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 28 03:59:59.786233 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.786233 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 28 03:59:59.786233 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 03:59:59.786233 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.786233 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 03:59:59.786233 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi '0' Jul 28 03:59:59.786233 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.786233 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:59.786233 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.786233 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:59.786233 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:59.786233 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:59.786233 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:59:59.786233 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:59:59.787541 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:59:59.787541 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:59:59.787541 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:59:59.787541 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:59:59.787541 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:59:59.787541 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:59:59.787541 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:59:59.787541 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:59:59.787541 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:59:59.787541 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:59:59.787541 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 03:59:59.787541 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.787541 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:59.787541 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.787541 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:59.787541 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:59.787541 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:59.787541 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:59:59.787541 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:59:59.788905 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 28 03:59:59.788905 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.790542 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a15c046b-e7e5-4c92-ad47-f483b68871f9 tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:59:59.792367 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-a15c046b-e7e5-4c92-ad47-f483b68871f9 tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.021476 Jul 28 03:59:59.794814 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 23/56] 10.222.0.46 () {60 vars in 1156 bytes} [Thu Jul 28 03:59:59 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:59:59.802775 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c939cbca-6d02-46a3-842a-3178677dab7a tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:59.805431 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c939cbca-6d02-46a3-842a-3178677dab7a tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 03:59:59.814848 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c939cbca-6d02-46a3-842a-3178677dab7a tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:59.815729 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c939cbca-6d02-46a3-842a-3178677dab7a tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:59.817190 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c939cbca-6d02-46a3-842a-3178677dab7a tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 03:59:59.817823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c939cbca-6d02-46a3-842a-3178677dab7a tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 03:59:59.892016 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b1b04556-e4c6-4741-97d8-bb704ec69484 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 03:59:59.900914 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b1b04556-e4c6-4741-97d8-bb704ec69484 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1367 microversion: 2.1 time: 0.248939 Jul 28 03:59:59.901613 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 34/57] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:59 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 03:59:59.906702 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-399527d8-990c-49ea-8607-1333a44d1d6f tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] Action: 'create', calling method: .version_select at 0x7fa6ee51faf0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-259389651", "metadata": {"Type": "work"}}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 03:59:59.911627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-399527d8-990c-49ea-8607-1333a44d1d6f tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] Request method failure captured: Jul 28 03:59:59.911627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 28 03:59:59.911627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 03:59:59.911627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 03:59:59.911627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 03:59:59.911627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 118 Jul 28 03:59:59.911627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 03:59:59.911627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 03:59:59.911627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 03:59:59.911627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 03:59:59.911627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gm_xpiQ2vIVEUP3kEtsaxjAFMgRWEhzK6u231u6I1tmaT0Df4lH2GBjkQ1AgYuOGX-FCN97up5_CHaab72V03Spi1GVVFcM1AMV3HZfma1l312kHM3hUusTuLXEqFSCrScXHg6EKzhPEKP-_VWbu2Jq9kGFpsS869e6s2eWE2Op53A Jul 28 03:59:59.911627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 03:59:59.911627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 03:59:59.911627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 03:59:59.911627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 03:59:59.911627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 03:59:59.911627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 03:59:59.911627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 7e4806116406458e83556bc47ae0a506 Jul 28 03:59:59.911627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-VolumesNegativeTest-1637051493 Jul 28 03:59:59.911627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 03:59:59.911627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 03:59:59.912814 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e4806116406458e83556bc47ae0a506", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e4806116406458e83556bc47ae0a506"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e4806116406458e83556bc47ae0a506"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e4806116406458e83556bc47ae0a506"}]}] Jul 28 03:59:59.912814 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-VolumesNegativeTest-1637051493 Jul 28 03:59:59.912814 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 7e4806116406458e83556bc47ae0a506 Jul 28 03:59:59.912814 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-VolumesNegativeTest-1637051493 Jul 28 03:59:59.912814 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-VolumesNegativeTest-1637051493-project Jul 28 03:59:59.912814 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 03:59:59.912814 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 03:59:59.912814 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: ce9adf52bd924ccc8e2c994b76914739 Jul 28 03:59:59.912814 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-VolumesNegativeTest-1637051493-project Jul 28 03:59:59.912814 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Jul 28 03:59:59.912814 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-259389651", "metadata": {"Type": "work"}}} Jul 28 03:59:59.912814 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: Jul 28 03:59:59.912814 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 03:59:59.913757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-259389651', 'metadata': {'Type': 'work'}}}} Jul 28 03:59:59.913757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:59:59.913757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:59.913757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 28 03:59:59.913757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 28 03:59:59.913757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 268, in validate Jul 28 03:59:59.913757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise error Jul 28 03:59:59.913757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 28 03:59:59.913757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.913757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 28 03:59:59.913757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 28 03:59:59.913757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.913757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 28 03:59:59.913757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi '' Jul 28 03:59:59.913757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.913757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:59.913757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.913757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:59.913757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:59.913757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:59.913757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:59:59.913757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:59:59.914850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:59:59.914850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:59:59.914850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:59:59.914850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:59:59.914850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 28 03:59:59.914850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 28 03:59:59.914850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 28 03:59:59.914850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 28 03:59:59.914850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 28 03:59:59.914850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 28 03:59:59.914850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 03:59:59.914850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.914850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:59.914850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.914850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:59.914850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:59.914850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:59.914850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 28 03:59:59.914850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 28 03:59:59.916010 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 28 03:59:59.916010 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.916010 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-399527d8-990c-49ea-8607-1333a44d1d6f tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:59:59.916953 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-399527d8-990c-49ea-8607-1333a44d1d6f tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] 10.222.0.46 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.013781 Jul 28 03:59:59.917530 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 35/58] 10.222.0.46 () {60 vars in 1156 bytes} [Thu Jul 28 03:59:59 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 15 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 03:59:59.930117 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a6e59825-1d8a-40cc-8f52-c5f588a43bba tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] Calling method '.version_select at 0x7fa6ee4739d0>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 03:59:59.979334 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-a6e59825-1d8a-40cc-8f52-c5f588a43bba tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] HTTP exception thrown: Volume tempest-invalid-247995601 could not be found. Jul 28 03:59:59.981213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a6e59825-1d8a-40cc-8f52-c5f588a43bba tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] Request method failure captured: Jul 28 03:59:59.981213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-247995601 HTTP/1.1 Jul 28 03:59:59.981213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 03:59:59.981213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 03:59:59.981213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 03:59:59.981213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 03:59:59.981213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 03:59:59.981213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 03:59:59.981213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 03:59:59.981213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 03:59:59.981213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gm_xpiQ2vIVEUP3kEtsaxjAFMgRWEhzK6u231u6I1tmaT0Df4lH2GBjkQ1AgYuOGX-FCN97up5_CHaab72V03Spi1GVVFcM1AMV3HZfma1l312kHM3hUusTuLXEqFSCrScXHg6EKzhPEKP-_VWbu2Jq9kGFpsS869e6s2eWE2Op53A Jul 28 03:59:59.981213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 03:59:59.981213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 03:59:59.981213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 03:59:59.981213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 03:59:59.981213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 03:59:59.981213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 03:59:59.981213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 7e4806116406458e83556bc47ae0a506 Jul 28 03:59:59.981213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-VolumesNegativeTest-1637051493 Jul 28 03:59:59.981213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 03:59:59.981213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 03:59:59.982317 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e4806116406458e83556bc47ae0a506", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e4806116406458e83556bc47ae0a506"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e4806116406458e83556bc47ae0a506"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e4806116406458e83556bc47ae0a506"}]}] Jul 28 03:59:59.982317 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-VolumesNegativeTest-1637051493 Jul 28 03:59:59.982317 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 7e4806116406458e83556bc47ae0a506 Jul 28 03:59:59.982317 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-VolumesNegativeTest-1637051493 Jul 28 03:59:59.982317 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-VolumesNegativeTest-1637051493-project Jul 28 03:59:59.982317 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 03:59:59.982317 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 03:59:59.982317 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: ce9adf52bd924ccc8e2c994b76914739 Jul 28 03:59:59.982317 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-VolumesNegativeTest-1637051493-project Jul 28 03:59:59.982317 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: Jul 28 03:59:59.982317 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Volume tempest-invalid-247995601 could not be found. Jul 28 03:59:59.982317 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': 'tempest-invalid-247995601'} Jul 28 03:59:59.982317 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 03:59:59.983019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:59.983019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:59:59.983019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:59:59.983019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 03:59:59.983019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 03:59:59.983019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 03:59:59.983019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 03:59:59.983019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 03:59:59.983019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 03:59:59.983019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 03:59:59.983019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 03:59:59.983019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:59:59.983019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:59:59.983019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:59:59.983019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:59:59.983019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-247995601 could not be found. (HTTP 404) (Request-ID: req-25973b02-4e37-43d5-a014-6eb4c2758aef) Jul 28 03:59:59.983019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.983019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:59.983019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.984330 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:59.984330 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 03:59:59.984330 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 03:59:59.984330 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 03:59:59.984330 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 03:59:59.984330 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 03:59:59.984330 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 03:59:59.984330 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 03:59:59.984330 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 03:59:59.984330 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 03:59:59.984330 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 03:59:59.984330 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 03:59:59.984330 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 03:59:59.984330 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 03:59:59.984330 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 03:59:59.984330 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 03:59:59.984330 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 03:59:59.984330 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 03:59:59.984330 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 03:59:59.985513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 03:59:59.985513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 03:59:59.985513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 03:59:59.985513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 03:59:59.985513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-247995601 could not be found. Jul 28 03:59:59.985513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.985513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:59.985513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.985513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:59.985513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:59.985513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:59.985513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 03:59:59.985513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 03:59:59.985513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 03:59:59.985513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 03:59:59.985513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 03:59:59.985513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 03:59:59.985513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 03:59:59.985513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 03:59:59.985513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-247995601 could not be found. Jul 28 03:59:59.987385 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.987385 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 03:59:59.987385 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.987385 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 03:59:59.987385 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 03:59:59.987385 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 03:59:59.987385 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 03:59:59.987385 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 03:59:59.987385 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-247995601 could not be found. Jul 28 03:59:59.987385 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 03:59:59.987385 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a6e59825-1d8a-40cc-8f52-c5f588a43bba tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] Returning 404 to user: Volume tempest-invalid-247995601 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 03:59:59.987385 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a6e59825-1d8a-40cc-8f52-c5f588a43bba tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/tempest-invalid-247995601" status: 404 len: 98 microversion: 2.1 time: 0.056941 Jul 28 03:59:59.987385 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 36/59] 10.222.0.46 () {58 vars in 1215 bytes} [Thu Jul 28 03:59:59 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-247995601 => generated 98 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 28 03:59:59.994042 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-27044db3-87a6-4bdb-a472-4ac3ac7d186b tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003755 Jul 28 03:59:59.994854 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 37/60] 10.222.0.46 () {58 vars in 1140 bytes} [Thu Jul 28 03:59:59 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 28 04:00:00.005262 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-51900ac3-61d6-4582-807e-92c140d543eb tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004259 Jul 28 04:00:00.005262 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 38/61] 10.222.0.46 () {58 vars in 1137 bytes} [Thu Jul 28 03:59:59 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Jul 28 04:00:00.011716 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-0944a58b-965b-4eb2-b8d3-9b01cc313a0f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:00.012341 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-0944a58b-965b-4eb2-b8d3-9b01cc313a0f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:00.018939 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0944a58b-965b-4eb2-b8d3-9b01cc313a0f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:00.019398 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0944a58b-965b-4eb2-b8d3-9b01cc313a0f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:00.020188 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0944a58b-965b-4eb2-b8d3-9b01cc313a0f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:00.020626 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0944a58b-965b-4eb2-b8d3-9b01cc313a0f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:00.135370 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-0944a58b-965b-4eb2-b8d3-9b01cc313a0f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:00.149274 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-0944a58b-965b-4eb2-b8d3-9b01cc313a0f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1287 microversion: 2.1 time: 0.140552 Jul 28 04:00:00.149834 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 39/62] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:00 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1287 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:00.155558 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-89f0185a-4e8b-4ff3-b909-b2ca6ac7e43e tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] Calling method '.version_select at 0x7fa6ee51f5e0>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:00.212690 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-89f0185a-4e8b-4ff3-b909-b2ca6ac7e43e tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] HTTP exception thrown: Volume 620e9821-be00-4306-9830-f409c3bb06aa could not be found. Jul 28 04:00:00.214942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-89f0185a-4e8b-4ff3-b909-b2ca6ac7e43e tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] Request method failure captured: Jul 28 04:00:00.214942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: DELETE /compute/v2.1/os-volumes/620e9821-be00-4306-9830-f409c3bb06aa HTTP/1.1 Jul 28 04:00:00.214942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:00:00.214942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:00:00.214942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:00:00.214942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:00:00.214942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:00:00.214942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:00:00.214942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:00:00.214942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:00.214942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gm_xpiQ2vIVEUP3kEtsaxjAFMgRWEhzK6u231u6I1tmaT0Df4lH2GBjkQ1AgYuOGX-FCN97up5_CHaab72V03Spi1GVVFcM1AMV3HZfma1l312kHM3hUusTuLXEqFSCrScXHg6EKzhPEKP-_VWbu2Jq9kGFpsS869e6s2eWE2Op53A Jul 28 04:00:00.214942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:00:00.214942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:00:00.214942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:00:00.214942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:00:00.214942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:00:00.214942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:00:00.214942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 7e4806116406458e83556bc47ae0a506 Jul 28 04:00:00.214942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-VolumesNegativeTest-1637051493 Jul 28 04:00:00.214942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:00:00.214942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:00:00.217296 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e4806116406458e83556bc47ae0a506", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e4806116406458e83556bc47ae0a506"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e4806116406458e83556bc47ae0a506"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e4806116406458e83556bc47ae0a506"}]}] Jul 28 04:00:00.217296 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-VolumesNegativeTest-1637051493 Jul 28 04:00:00.217296 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 7e4806116406458e83556bc47ae0a506 Jul 28 04:00:00.217296 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-VolumesNegativeTest-1637051493 Jul 28 04:00:00.217296 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-VolumesNegativeTest-1637051493-project Jul 28 04:00:00.217296 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:00:00.217296 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:00:00.217296 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: ce9adf52bd924ccc8e2c994b76914739 Jul 28 04:00:00.217296 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-VolumesNegativeTest-1637051493-project Jul 28 04:00:00.217296 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: Jul 28 04:00:00.217296 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Volume 620e9821-be00-4306-9830-f409c3bb06aa could not be found. Jul 28 04:00:00.217296 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': '620e9821-be00-4306-9830-f409c3bb06aa'} Jul 28 04:00:00.217296 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:00.218443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:00.218443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 04:00:00.218443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 04:00:00.218443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 04:00:00.218443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 04:00:00.218443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 04:00:00.218443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 04:00:00.218443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 04:00:00.218443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 04:00:00.218443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 04:00:00.218443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 04:00:00.218443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 04:00:00.218443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 04:00:00.218443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 04:00:00.218443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 04:00:00.218443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 620e9821-be00-4306-9830-f409c3bb06aa could not be found. (HTTP 404) (Request-ID: req-0f1faec2-6d7a-490c-a531-b55f3da4e274) Jul 28 04:00:00.218443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:00:00.218443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:00.218443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:00:00.220231 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:00.220231 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 28 04:00:00.220231 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 28 04:00:00.220231 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 04:00:00.220231 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 04:00:00.220231 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 04:00:00.220231 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 04:00:00.220231 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 04:00:00.220231 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 04:00:00.220231 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 04:00:00.220231 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 04:00:00.220231 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 28 04:00:00.220231 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 28 04:00:00.220231 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 28 04:00:00.220231 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 28 04:00:00.220231 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 28 04:00:00.220231 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 28 04:00:00.220231 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 28 04:00:00.220231 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 28 04:00:00.224482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 04:00:00.224482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 04:00:00.224482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 04:00:00.224482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 04:00:00.224482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 620e9821-be00-4306-9830-f409c3bb06aa could not be found. Jul 28 04:00:00.224482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:00:00.224482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:00.224482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:00:00.224482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:00.224482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:00.224482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:00.224482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:00.224482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:00.224482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 04:00:00.224482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 04:00:00.224482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:00.224482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:00.224482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 28 04:00:00.224482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:00:00.227769 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 620e9821-be00-4306-9830-f409c3bb06aa could not be found. Jul 28 04:00:00.227769 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:00:00.227769 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:00.227769 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:00:00.227769 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:00.227769 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:00.227769 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:00.227769 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:00:00.227769 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:00:00.227769 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 620e9821-be00-4306-9830-f409c3bb06aa could not be found. Jul 28 04:00:00.227769 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:00:00.227769 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-89f0185a-4e8b-4ff3-b909-b2ca6ac7e43e tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] Returning 404 to user: Volume 620e9821-be00-4306-9830-f409c3bb06aa could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:00.228715 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-89f0185a-4e8b-4ff3-b909-b2ca6ac7e43e tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] 10.222.0.46 "DELETE /compute/v2.1/os-volumes/620e9821-be00-4306-9830-f409c3bb06aa" status: 404 len: 109 microversion: 2.1 time: 0.077033 Jul 28 04:00:00.229157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 40/63] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Jul 28 04:00:00 2022] DELETE /compute/v2.1/os-volumes/620e9821-be00-4306-9830-f409c3bb06aa => generated 109 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:00:00.236989 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-61e7133e-9d1a-44d1-9afa-fb422817c660 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:00.237601 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-61e7133e-9d1a-44d1-9afa-fb422817c660 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:00.261721 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:00.267270 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-61e7133e-9d1a-44d1-9afa-fb422817c660 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:00.268381 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-61e7133e-9d1a-44d1-9afa-fb422817c660 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:00.269383 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-61e7133e-9d1a-44d1-9afa-fb422817c660 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:00.269982 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-61e7133e-9d1a-44d1-9afa-fb422817c660 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:00.569629 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-61e7133e-9d1a-44d1-9afa-fb422817c660 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:00.587307 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-61e7133e-9d1a-44d1-9afa-fb422817c660 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1321 microversion: 2.1 time: 0.357066 Jul 28 04:00:00.591645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 41/64] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:00 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1321 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:00.606049 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-57609de8-7a1f-4b21-904f-88a276d54b13 tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] Calling method '.version_select at 0x7fa6ee51f4c0>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:00.743602 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-57609de8-7a1f-4b21-904f-88a276d54b13 tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] HTTP exception thrown: Volume 18aaed10-6e04-4a38-ace8-4120d82f3c18 could not be found. Jul 28 04:00:00.746101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-57609de8-7a1f-4b21-904f-88a276d54b13 tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] Request method failure captured: Jul 28 04:00:00.746101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/os-volumes/18aaed10-6e04-4a38-ace8-4120d82f3c18 HTTP/1.1 Jul 28 04:00:00.746101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:00:00.746101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:00:00.746101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:00:00.746101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:00:00.746101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:00:00.746101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:00:00.746101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:00:00.746101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:00.746101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gm_xpiQ2vIVEUP3kEtsaxjAFMgRWEhzK6u231u6I1tmaT0Df4lH2GBjkQ1AgYuOGX-FCN97up5_CHaab72V03Spi1GVVFcM1AMV3HZfma1l312kHM3hUusTuLXEqFSCrScXHg6EKzhPEKP-_VWbu2Jq9kGFpsS869e6s2eWE2Op53A Jul 28 04:00:00.746101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:00:00.746101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:00:00.746101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:00:00.746101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:00:00.746101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:00:00.746101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:00:00.746101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 7e4806116406458e83556bc47ae0a506 Jul 28 04:00:00.746101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-VolumesNegativeTest-1637051493 Jul 28 04:00:00.746101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:00:00.746101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:00:00.747526 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_7e4806116406458e83556bc47ae0a506", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e4806116406458e83556bc47ae0a506"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/7e4806116406458e83556bc47ae0a506"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/7e4806116406458e83556bc47ae0a506"}]}] Jul 28 04:00:00.747526 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-VolumesNegativeTest-1637051493 Jul 28 04:00:00.747526 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 7e4806116406458e83556bc47ae0a506 Jul 28 04:00:00.747526 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-VolumesNegativeTest-1637051493 Jul 28 04:00:00.747526 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-VolumesNegativeTest-1637051493-project Jul 28 04:00:00.747526 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:00:00.747526 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:00:00.747526 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: ce9adf52bd924ccc8e2c994b76914739 Jul 28 04:00:00.747526 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-VolumesNegativeTest-1637051493-project Jul 28 04:00:00.747526 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: Jul 28 04:00:00.747526 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Volume 18aaed10-6e04-4a38-ace8-4120d82f3c18 could not be found. Jul 28 04:00:00.747526 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': '18aaed10-6e04-4a38-ace8-4120d82f3c18'} Jul 28 04:00:00.747526 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:00.748254 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:00.748254 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 04:00:00.748254 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 04:00:00.748254 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 04:00:00.748254 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 04:00:00.748254 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 04:00:00.748254 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 04:00:00.748254 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 04:00:00.748254 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 04:00:00.748254 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 04:00:00.748254 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 04:00:00.748254 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 04:00:00.748254 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 04:00:00.748254 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 04:00:00.748254 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 04:00:00.748254 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 18aaed10-6e04-4a38-ace8-4120d82f3c18 could not be found. (HTTP 404) (Request-ID: req-c5108f50-4250-4eb2-aafd-f90f7bb5068b) Jul 28 04:00:00.748254 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:00:00.748254 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:00.748254 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:00:00.749271 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:00.749271 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 28 04:00:00.749271 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 28 04:00:00.749271 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 28 04:00:00.749271 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 28 04:00:00.749271 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 28 04:00:00.749271 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 28 04:00:00.749271 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 28 04:00:00.749271 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 28 04:00:00.749271 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 28 04:00:00.749271 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 28 04:00:00.749271 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 28 04:00:00.749271 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 28 04:00:00.749271 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 28 04:00:00.749271 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 28 04:00:00.749271 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 28 04:00:00.749271 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 28 04:00:00.749271 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 28 04:00:00.749271 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 28 04:00:00.750302 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 28 04:00:00.750302 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 28 04:00:00.750302 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 28 04:00:00.750302 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 28 04:00:00.750302 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 18aaed10-6e04-4a38-ace8-4120d82f3c18 could not be found. Jul 28 04:00:00.750302 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:00:00.750302 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:00.750302 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:00:00.750302 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:00.750302 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:00.750302 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:00.750302 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:00.750302 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:00.750302 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 28 04:00:00.750302 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 28 04:00:00.750302 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:00.750302 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:00.750302 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 28 04:00:00.750302 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:00:00.753217 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 18aaed10-6e04-4a38-ace8-4120d82f3c18 could not be found. Jul 28 04:00:00.753217 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:00:00.753217 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:00.753217 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:00:00.753217 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:00.753217 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:00.753217 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:00.753217 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:00:00.753217 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:00:00.753217 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 18aaed10-6e04-4a38-ace8-4120d82f3c18 could not be found. Jul 28 04:00:00.753217 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:00:00.753217 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-57609de8-7a1f-4b21-904f-88a276d54b13 tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] Returning 404 to user: Volume 18aaed10-6e04-4a38-ace8-4120d82f3c18 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:00.753217 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-57609de8-7a1f-4b21-904f-88a276d54b13 tempest-VolumesNegativeTest-1637051493 tempest-VolumesNegativeTest-1637051493-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/18aaed10-6e04-4a38-ace8-4120d82f3c18" status: 404 len: 109 microversion: 2.1 time: 0.152608 Jul 28 04:00:00.758212 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 42/65] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 04:00:00 2022] GET /compute/v2.1/os-volumes/18aaed10-6e04-4a38-ace8-4120d82f3c18 => generated 109 bytes in 165 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:00:00.785215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-c939cbca-6d02-46a3-842a-3178677dab7a tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:00.801850 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-c939cbca-6d02-46a3-842a-3178677dab7a tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1315 microversion: 2.1 time: 1.005639 Jul 28 04:00:00.803254 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 24/66] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 03:59:59 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1315 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:00.926725 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-42ae3794-255a-4fe6-83a8-05902e281fbe tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:00.927780 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-42ae3794-255a-4fe6-83a8-05902e281fbe tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:00.949759 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-42ae3794-255a-4fe6-83a8-05902e281fbe tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:00.950584 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-42ae3794-255a-4fe6-83a8-05902e281fbe tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:00.951600 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-42ae3794-255a-4fe6-83a8-05902e281fbe tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:00.952183 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-42ae3794-255a-4fe6-83a8-05902e281fbe tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:01.171081 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-f6c58ab9-47a5-4f9e-9373-69da80cf7d4b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:01.173343 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-f6c58ab9-47a5-4f9e-9373-69da80cf7d4b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:01.194735 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f6c58ab9-47a5-4f9e-9373-69da80cf7d4b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:01.195506 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f6c58ab9-47a5-4f9e-9373-69da80cf7d4b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:01.196446 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f6c58ab9-47a5-4f9e-9373-69da80cf7d4b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:01.197490 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f6c58ab9-47a5-4f9e-9373-69da80cf7d4b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:01.210539 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-42ae3794-255a-4fe6-83a8-05902e281fbe tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:01.221943 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-42ae3794-255a-4fe6-83a8-05902e281fbe tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1367 microversion: 2.1 time: 0.301194 Jul 28 04:00:01.222532 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 43/67] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:00 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:01.356703 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-f6c58ab9-47a5-4f9e-9373-69da80cf7d4b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:01.370303 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-f6c58ab9-47a5-4f9e-9373-69da80cf7d4b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1287 microversion: 2.1 time: 0.204352 Jul 28 04:00:01.388690 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 25/68] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:01 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1287 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:01.522891 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-d75ff0bd-7983-444c-9663-2d7a1f93af27 req-1e7a8657-8406-4c97-ac09-6c7e3e8bbe31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f962971f-7600-40e0-9c46-257d1aa54ec0", "tag": "69a10956-82b0-477c-a7f6-0a2b2734d31e"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:01.542400 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-d75ff0bd-7983-444c-9663-2d7a1f93af27 req-1e7a8657-8406-4c97-ac09-6c7e3e8bbe31 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:01.542865 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-d75ff0bd-7983-444c-9663-2d7a1f93af27 req-1e7a8657-8406-4c97-ac09-6c7e3e8bbe31 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:01.573533 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-d75ff0bd-7983-444c-9663-2d7a1f93af27 req-1e7a8657-8406-4c97-ac09-6c7e3e8bbe31 service nova] Creating event network-changed:69a10956-82b0-477c-a7f6-0a2b2734d31e for instance f962971f-7600-40e0-9c46-257d1aa54ec0 on hv-cinder-79987 Jul 28 04:00:01.574360 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-d75ff0bd-7983-444c-9663-2d7a1f93af27 req-1e7a8657-8406-4c97-ac09-6c7e3e8bbe31 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118187) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 28 04:00:01.575690 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cf5e495a-41ad-4db0-a884-e682b181cba2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:01.576194 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cf5e495a-41ad-4db0-a884-e682b181cba2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:01.577361 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cf5e495a-41ad-4db0-a884-e682b181cba2 None None] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:01.578037 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cf5e495a-41ad-4db0-a884-e682b181cba2 None None] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:01.596664 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.compute.rpcapi [None req-cf5e495a-41ad-4db0-a884-e682b181cba2 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 28 04:00:01.598389 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cf5e495a-41ad-4db0-a884-e682b181cba2 None None] Releasing lock "compute-rpcapi-router" {{(pid=118187) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 28 04:00:01.615637 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-543c02d1-c091-4483-8d77-4cbf7aa8134f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:01.616264 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-543c02d1-c091-4483-8d77-4cbf7aa8134f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:01.621991 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-cf5e495a-41ad-4db0-a884-e682b181cba2 None None] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181885 Jul 28 04:00:01.622558 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-543c02d1-c091-4483-8d77-4cbf7aa8134f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:01.623091 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 44/69] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:00:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:01.623359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-543c02d1-c091-4483-8d77-4cbf7aa8134f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:01.624162 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-543c02d1-c091-4483-8d77-4cbf7aa8134f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:01.624602 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-543c02d1-c091-4483-8d77-4cbf7aa8134f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:01.826026 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ce858fbe-2099-488f-a58d-2117819cfca0 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:01.827482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ce858fbe-2099-488f-a58d-2117819cfca0 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:01.829526 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-543c02d1-c091-4483-8d77-4cbf7aa8134f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:01.837731 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-543c02d1-c091-4483-8d77-4cbf7aa8134f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1321 microversion: 2.1 time: 0.226360 Jul 28 04:00:01.838320 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 26/70] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:01 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:01.843564 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ce858fbe-2099-488f-a58d-2117819cfca0 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:01.845746 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ce858fbe-2099-488f-a58d-2117819cfca0 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:01.846597 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ce858fbe-2099-488f-a58d-2117819cfca0 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:01.847145 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ce858fbe-2099-488f-a58d-2117819cfca0 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:02.004067 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ce858fbe-2099-488f-a58d-2117819cfca0 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:02.011989 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ce858fbe-2099-488f-a58d-2117819cfca0 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1315 microversion: 2.1 time: 0.191094 Jul 28 04:00:02.012664 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 45/71] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:01 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:02.245823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-b2f54185-976e-4ee0-98db-1203cecd5a25 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:02.246443 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-b2f54185-976e-4ee0-98db-1203cecd5a25 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:02.254205 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b2f54185-976e-4ee0-98db-1203cecd5a25 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:02.255256 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b2f54185-976e-4ee0-98db-1203cecd5a25 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:02.256597 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b2f54185-976e-4ee0-98db-1203cecd5a25 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:02.257577 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b2f54185-976e-4ee0-98db-1203cecd5a25 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:02.397659 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-55045f89-2764-4145-a17f-81f23cab1a1e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:02.398612 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-55045f89-2764-4145-a17f-81f23cab1a1e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:02.405928 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55045f89-2764-4145-a17f-81f23cab1a1e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:02.406737 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55045f89-2764-4145-a17f-81f23cab1a1e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:02.408479 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55045f89-2764-4145-a17f-81f23cab1a1e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:02.409115 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55045f89-2764-4145-a17f-81f23cab1a1e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:02.414817 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=100 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:02.687623 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-55045f89-2764-4145-a17f-81f23cab1a1e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:02.699515 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-55045f89-2764-4145-a17f-81f23cab1a1e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1287 microversion: 2.1 time: 0.306417 Jul 28 04:00:02.700101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 46/72] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:02 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1287 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:02.710118 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-b2f54185-976e-4ee0-98db-1203cecd5a25 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:02.720905 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-b2f54185-976e-4ee0-98db-1203cecd5a25 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1367 microversion: 2.1 time: 0.480576 Jul 28 04:00:02.730829 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 27/73] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:02 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1367 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:02.863048 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-72422648-67e1-4250-9cbc-6fbcd4d63495 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:02.863833 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-72422648-67e1-4250-9cbc-6fbcd4d63495 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:02.870458 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-72422648-67e1-4250-9cbc-6fbcd4d63495 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:02.871349 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-72422648-67e1-4250-9cbc-6fbcd4d63495 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:02.872113 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-72422648-67e1-4250-9cbc-6fbcd4d63495 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:02.872704 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-72422648-67e1-4250-9cbc-6fbcd4d63495 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:03.039966 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c34a0bbb-2273-4c7c-8913-b3bd62d02bd5 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:03.041443 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c34a0bbb-2273-4c7c-8913-b3bd62d02bd5 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:03.057162 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c34a0bbb-2273-4c7c-8913-b3bd62d02bd5 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:03.058167 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c34a0bbb-2273-4c7c-8913-b3bd62d02bd5 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:03.059582 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c34a0bbb-2273-4c7c-8913-b3bd62d02bd5 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:03.060923 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c34a0bbb-2273-4c7c-8913-b3bd62d02bd5 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:03.110212 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-72422648-67e1-4250-9cbc-6fbcd4d63495 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:03.123882 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-72422648-67e1-4250-9cbc-6fbcd4d63495 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1321 microversion: 2.1 time: 0.266910 Jul 28 04:00:03.124921 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 47/74] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:02 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:03.253539 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-c34a0bbb-2273-4c7c-8913-b3bd62d02bd5 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:03.261710 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-c34a0bbb-2273-4c7c-8913-b3bd62d02bd5 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1315 microversion: 2.1 time: 0.231904 Jul 28 04:00:03.262415 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 28/75] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:03 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:03.726627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2b6ebf33-d6cc-49a5-a28c-81a6bb3dd6c8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:03.728516 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-2b6ebf33-d6cc-49a5-a28c-81a6bb3dd6c8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:03.739950 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2b6ebf33-d6cc-49a5-a28c-81a6bb3dd6c8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:03.740691 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2b6ebf33-d6cc-49a5-a28c-81a6bb3dd6c8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:03.741702 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2b6ebf33-d6cc-49a5-a28c-81a6bb3dd6c8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:03.742279 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2b6ebf33-d6cc-49a5-a28c-81a6bb3dd6c8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:03.744499 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-174f9b2d-c3ff-4aba-a9f8-57ab644eb487 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:03.746118 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-174f9b2d-c3ff-4aba-a9f8-57ab644eb487 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:03.756705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-174f9b2d-c3ff-4aba-a9f8-57ab644eb487 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:03.757437 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-174f9b2d-c3ff-4aba-a9f8-57ab644eb487 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:03.758751 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-174f9b2d-c3ff-4aba-a9f8-57ab644eb487 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:03.759670 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-174f9b2d-c3ff-4aba-a9f8-57ab644eb487 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:03.865585 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-2b6ebf33-d6cc-49a5-a28c-81a6bb3dd6c8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:03.879570 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-2b6ebf33-d6cc-49a5-a28c-81a6bb3dd6c8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1287 microversion: 2.1 time: 0.162458 Jul 28 04:00:03.881045 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 48/76] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:03 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1287 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:04.049018 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-174f9b2d-c3ff-4aba-a9f8-57ab644eb487 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:04.069886 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-174f9b2d-c3ff-4aba-a9f8-57ab644eb487 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1367 microversion: 2.1 time: 0.323290 Jul 28 04:00:04.070619 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 29/77] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:03 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1367 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:04.148886 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-48ccf728-4515-44a2-ac12-4258468d6f9b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:04.149937 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-48ccf728-4515-44a2-ac12-4258468d6f9b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:04.166404 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-48ccf728-4515-44a2-ac12-4258468d6f9b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:04.170268 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-48ccf728-4515-44a2-ac12-4258468d6f9b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:04.175539 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-48ccf728-4515-44a2-ac12-4258468d6f9b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:04.176213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-48ccf728-4515-44a2-ac12-4258468d6f9b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:04.286824 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-19fd3440-341e-4a6b-8c7d-edcc8c75d45c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:04.287515 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-19fd3440-341e-4a6b-8c7d-edcc8c75d45c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:04.297074 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-19fd3440-341e-4a6b-8c7d-edcc8c75d45c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:04.300974 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-19fd3440-341e-4a6b-8c7d-edcc8c75d45c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:04.304260 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-19fd3440-341e-4a6b-8c7d-edcc8c75d45c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:04.308716 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-19fd3440-341e-4a6b-8c7d-edcc8c75d45c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:04.458715 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-48ccf728-4515-44a2-ac12-4258468d6f9b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:04.468885 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-48ccf728-4515-44a2-ac12-4258468d6f9b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1321 microversion: 2.1 time: 0.323902 Jul 28 04:00:04.470025 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 49/78] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:04 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:04.548642 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-19fd3440-341e-4a6b-8c7d-edcc8c75d45c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:04.557919 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-19fd3440-341e-4a6b-8c7d-edcc8c75d45c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1315 microversion: 2.1 time: 0.275580 Jul 28 04:00:04.564757 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 30/79] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:04 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1315 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:04.900856 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2ae48acd-60fa-4fe3-9d93-42101e47f57f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:04.901462 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-2ae48acd-60fa-4fe3-9d93-42101e47f57f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:04.913686 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2ae48acd-60fa-4fe3-9d93-42101e47f57f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:04.914209 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2ae48acd-60fa-4fe3-9d93-42101e47f57f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:04.914929 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2ae48acd-60fa-4fe3-9d93-42101e47f57f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:04.915366 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2ae48acd-60fa-4fe3-9d93-42101e47f57f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:05.040773 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-2ae48acd-60fa-4fe3-9d93-42101e47f57f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:05.051937 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-2ae48acd-60fa-4fe3-9d93-42101e47f57f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1287 microversion: 2.1 time: 0.154834 Jul 28 04:00:05.053214 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 50/80] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:04 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1287 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:05.098507 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-994edc7d-b36e-47b7-9e09-8c5cefe024c7 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:05.103794 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-994edc7d-b36e-47b7-9e09-8c5cefe024c7 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:05.115574 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-994edc7d-b36e-47b7-9e09-8c5cefe024c7 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:05.116402 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-994edc7d-b36e-47b7-9e09-8c5cefe024c7 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:05.117177 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-994edc7d-b36e-47b7-9e09-8c5cefe024c7 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:05.118454 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-994edc7d-b36e-47b7-9e09-8c5cefe024c7 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:05.301245 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-994edc7d-b36e-47b7-9e09-8c5cefe024c7 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:05.310956 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-994edc7d-b36e-47b7-9e09-8c5cefe024c7 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1367 microversion: 2.1 time: 0.218303 Jul 28 04:00:05.311548 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 31/81] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:05 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1367 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:05.491275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e4898020-49ff-4232-a72d-25fc4d0987b4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:05.491882 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e4898020-49ff-4232-a72d-25fc4d0987b4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:05.500305 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e4898020-49ff-4232-a72d-25fc4d0987b4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:05.501446 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e4898020-49ff-4232-a72d-25fc4d0987b4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:05.502323 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e4898020-49ff-4232-a72d-25fc4d0987b4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:05.502762 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e4898020-49ff-4232-a72d-25fc4d0987b4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:05.590095 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-d94b9156-30be-4fbc-8bdd-e19aed282d7f tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:05.591158 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-d94b9156-30be-4fbc-8bdd-e19aed282d7f tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:05.597556 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell0:SELECT=24 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:05.600495 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d94b9156-30be-4fbc-8bdd-e19aed282d7f tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:05.601458 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d94b9156-30be-4fbc-8bdd-e19aed282d7f tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:05.602265 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d94b9156-30be-4fbc-8bdd-e19aed282d7f tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:05.602992 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d94b9156-30be-4fbc-8bdd-e19aed282d7f tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:05.745832 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e4898020-49ff-4232-a72d-25fc4d0987b4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:05.755792 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e4898020-49ff-4232-a72d-25fc4d0987b4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1321 microversion: 2.1 time: 0.268323 Jul 28 04:00:05.759010 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 51/82] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:05 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1321 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:05.867499 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-d94b9156-30be-4fbc-8bdd-e19aed282d7f tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:05.880882 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-d94b9156-30be-4fbc-8bdd-e19aed282d7f tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1315 microversion: 2.1 time: 0.298459 Jul 28 04:00:05.881668 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 32/83] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:05 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1315 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:06.090179 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-87322dc4-31cb-4bfd-a4e8-724004f3a495 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:06.090949 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-87322dc4-31cb-4bfd-a4e8-724004f3a495 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:06.105138 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-87322dc4-31cb-4bfd-a4e8-724004f3a495 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:06.106629 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-87322dc4-31cb-4bfd-a4e8-724004f3a495 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:06.108220 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-87322dc4-31cb-4bfd-a4e8-724004f3a495 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:06.116787 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-87322dc4-31cb-4bfd-a4e8-724004f3a495 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:06.218181 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-87322dc4-31cb-4bfd-a4e8-724004f3a495 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:06.227546 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-87322dc4-31cb-4bfd-a4e8-724004f3a495 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1287 microversion: 2.1 time: 0.155034 Jul 28 04:00:06.230917 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 52/84] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:06 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1287 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:06.337993 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-8e628440-7159-4527-ad30-e41493793f11 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:06.340334 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-8e628440-7159-4527-ad30-e41493793f11 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:06.343288 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=82,nova_api:INSERT=9 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:06.360543 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8e628440-7159-4527-ad30-e41493793f11 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:06.361713 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8e628440-7159-4527-ad30-e41493793f11 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:06.362658 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8e628440-7159-4527-ad30-e41493793f11 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:06.363566 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8e628440-7159-4527-ad30-e41493793f11 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:06.377809 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=89 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:06.729436 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-8e628440-7159-4527-ad30-e41493793f11 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:06.739737 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-8e628440-7159-4527-ad30-e41493793f11 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1367 microversion: 2.1 time: 0.407957 Jul 28 04:00:06.761516 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 33/85] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:06 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1367 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:06.780747 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-185bcbcb-da33-4cd5-90e3-87cb352acca2 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:06.781370 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-185bcbcb-da33-4cd5-90e3-87cb352acca2 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:06.783867 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=28 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:06.793451 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-185bcbcb-da33-4cd5-90e3-87cb352acca2 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:06.803088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-185bcbcb-da33-4cd5-90e3-87cb352acca2 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:06.803088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-185bcbcb-da33-4cd5-90e3-87cb352acca2 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:06.803088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-185bcbcb-da33-4cd5-90e3-87cb352acca2 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:06.901807 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-76e6f34c-53ce-43cb-81ce-5f6453be9f85 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:06.902896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-76e6f34c-53ce-43cb-81ce-5f6453be9f85 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:06.913936 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-76e6f34c-53ce-43cb-81ce-5f6453be9f85 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:06.917527 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-76e6f34c-53ce-43cb-81ce-5f6453be9f85 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:06.920615 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-76e6f34c-53ce-43cb-81ce-5f6453be9f85 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:06.921956 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-76e6f34c-53ce-43cb-81ce-5f6453be9f85 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:07.093891 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-185bcbcb-da33-4cd5-90e3-87cb352acca2 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:07.106732 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-185bcbcb-da33-4cd5-90e3-87cb352acca2 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1321 microversion: 2.1 time: 0.329690 Jul 28 04:00:07.121112 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 53/86] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:06 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1321 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:07.128064 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-76e6f34c-53ce-43cb-81ce-5f6453be9f85 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:07.139479 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-76e6f34c-53ce-43cb-81ce-5f6453be9f85 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1315 microversion: 2.1 time: 0.241372 Jul 28 04:00:07.140070 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 34/87] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:06 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:07.258608 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b054e697-f166-4ae9-aa9e-fa5bd7b739c3 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:07.259410 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b054e697-f166-4ae9-aa9e-fa5bd7b739c3 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:07.273014 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b054e697-f166-4ae9-aa9e-fa5bd7b739c3 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:07.273385 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b054e697-f166-4ae9-aa9e-fa5bd7b739c3 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:07.274168 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b054e697-f166-4ae9-aa9e-fa5bd7b739c3 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:07.274796 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b054e697-f166-4ae9-aa9e-fa5bd7b739c3 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:07.383612 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b054e697-f166-4ae9-aa9e-fa5bd7b739c3 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:07.394386 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b054e697-f166-4ae9-aa9e-fa5bd7b739c3 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1287 microversion: 2.1 time: 0.144785 Jul 28 04:00:07.399332 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 54/88] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:07 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1287 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:07.762279 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-3a5decbf-d9e2-4449-8f51-603566e5aa32 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:07.762933 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-3a5decbf-d9e2-4449-8f51-603566e5aa32 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:07.776215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3a5decbf-d9e2-4449-8f51-603566e5aa32 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:07.776675 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3a5decbf-d9e2-4449-8f51-603566e5aa32 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:07.777459 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3a5decbf-d9e2-4449-8f51-603566e5aa32 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:07.777914 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3a5decbf-d9e2-4449-8f51-603566e5aa32 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:07.923125 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-3a5decbf-d9e2-4449-8f51-603566e5aa32 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:07.930642 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-3a5decbf-d9e2-4449-8f51-603566e5aa32 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1367 microversion: 2.1 time: 0.172469 Jul 28 04:00:07.931246 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 35/89] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:07 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:08.130404 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-07178b5d-8b54-4821-867c-f56cc4d1ddda tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:08.131046 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-07178b5d-8b54-4821-867c-f56cc4d1ddda tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:08.145648 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-07178b5d-8b54-4821-867c-f56cc4d1ddda tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:08.146213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-07178b5d-8b54-4821-867c-f56cc4d1ddda tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:08.147022 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-07178b5d-8b54-4821-867c-f56cc4d1ddda tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:08.147609 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-07178b5d-8b54-4821-867c-f56cc4d1ddda tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:08.162118 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-9d82ea02-e9c6-407e-8346-7b9db807705e tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:08.162741 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-9d82ea02-e9c6-407e-8346-7b9db807705e tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:08.169202 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9d82ea02-e9c6-407e-8346-7b9db807705e tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:08.169659 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9d82ea02-e9c6-407e-8346-7b9db807705e tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:08.170430 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9d82ea02-e9c6-407e-8346-7b9db807705e tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:08.170895 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9d82ea02-e9c6-407e-8346-7b9db807705e tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:08.301520 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-07178b5d-8b54-4821-867c-f56cc4d1ddda tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:08.311779 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-07178b5d-8b54-4821-867c-f56cc4d1ddda tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1321 microversion: 2.1 time: 0.185869 Jul 28 04:00:08.321379 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 55/90] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:08 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:08.321702 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-9d82ea02-e9c6-407e-8346-7b9db807705e tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:08.328862 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-9d82ea02-e9c6-407e-8346-7b9db807705e tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1315 microversion: 2.1 time: 0.170352 Jul 28 04:00:08.329897 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 36/91] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:08 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:08.417122 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-42589bc7-8a36-4548-9fd1-90bf330afab0 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:08.417756 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-42589bc7-8a36-4548-9fd1-90bf330afab0 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:08.423718 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-42589bc7-8a36-4548-9fd1-90bf330afab0 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:08.424159 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-42589bc7-8a36-4548-9fd1-90bf330afab0 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:08.424908 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-42589bc7-8a36-4548-9fd1-90bf330afab0 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:08.425334 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-42589bc7-8a36-4548-9fd1-90bf330afab0 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:08.488079 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-42589bc7-8a36-4548-9fd1-90bf330afab0 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:08.495963 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-42589bc7-8a36-4548-9fd1-90bf330afab0 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1287 microversion: 2.1 time: 0.082982 Jul 28 04:00:08.496689 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 56/92] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:08 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1287 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:08.951768 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-4e4f6714-dc3d-4893-8a17-442ea3157015 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:08.952474 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-4e4f6714-dc3d-4893-8a17-442ea3157015 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:08.959209 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4e4f6714-dc3d-4893-8a17-442ea3157015 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:08.959806 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4e4f6714-dc3d-4893-8a17-442ea3157015 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:08.960570 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4e4f6714-dc3d-4893-8a17-442ea3157015 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:08.961009 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4e4f6714-dc3d-4893-8a17-442ea3157015 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:09.093893 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-4e4f6714-dc3d-4893-8a17-442ea3157015 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:09.102145 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-4e4f6714-dc3d-4893-8a17-442ea3157015 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1367 microversion: 2.1 time: 0.154161 Jul 28 04:00:09.102815 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 37/93] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:08 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:09.332824 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7cce9e5d-3047-4d02-80a7-80982d62af91 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:09.333331 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7cce9e5d-3047-4d02-80a7-80982d62af91 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:09.339476 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7cce9e5d-3047-4d02-80a7-80982d62af91 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:09.339932 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7cce9e5d-3047-4d02-80a7-80982d62af91 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:09.340697 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7cce9e5d-3047-4d02-80a7-80982d62af91 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:09.341134 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7cce9e5d-3047-4d02-80a7-80982d62af91 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:09.351792 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-6b17ae90-2133-480a-ae73-90e5e4419bc6 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:09.352829 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-6b17ae90-2133-480a-ae73-90e5e4419bc6 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:09.359221 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6b17ae90-2133-480a-ae73-90e5e4419bc6 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:09.359851 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6b17ae90-2133-480a-ae73-90e5e4419bc6 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:09.360857 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6b17ae90-2133-480a-ae73-90e5e4419bc6 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:09.361405 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6b17ae90-2133-480a-ae73-90e5e4419bc6 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:09.483465 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7cce9e5d-3047-4d02-80a7-80982d62af91 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:09.493773 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7cce9e5d-3047-4d02-80a7-80982d62af91 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1321 microversion: 2.1 time: 0.165365 Jul 28 04:00:09.494427 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 57/94] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:09 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:09.517937 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ca665dec-b490-4724-bf10-85c498f2a833 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:09.518856 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ca665dec-b490-4724-bf10-85c498f2a833 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:09.525037 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ca665dec-b490-4724-bf10-85c498f2a833 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:09.525565 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ca665dec-b490-4724-bf10-85c498f2a833 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:09.526413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ca665dec-b490-4724-bf10-85c498f2a833 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:09.526953 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ca665dec-b490-4724-bf10-85c498f2a833 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:09.582052 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-6b17ae90-2133-480a-ae73-90e5e4419bc6 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:09.591352 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-6b17ae90-2133-480a-ae73-90e5e4419bc6 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1315 microversion: 2.1 time: 0.243613 Jul 28 04:00:09.592119 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 38/95] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:09 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1315 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:09.609168 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ca665dec-b490-4724-bf10-85c498f2a833 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:09.616884 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ca665dec-b490-4724-bf10-85c498f2a833 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1287 microversion: 2.1 time: 0.104087 Jul 28 04:00:09.617468 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 58/96] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:09 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1287 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:10.126734 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-b4179321-0de6-4a43-b960-a91ffef93213 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:10.128312 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-b4179321-0de6-4a43-b960-a91ffef93213 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:10.139468 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell0:SELECT=8 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:10.142761 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b4179321-0de6-4a43-b960-a91ffef93213 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:10.144564 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b4179321-0de6-4a43-b960-a91ffef93213 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:10.147116 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b4179321-0de6-4a43-b960-a91ffef93213 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:10.148515 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b4179321-0de6-4a43-b960-a91ffef93213 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:10.516965 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-de2d50dd-6184-42f4-99c0-ddbe2f98619b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:10.517591 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-de2d50dd-6184-42f4-99c0-ddbe2f98619b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:10.524552 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-de2d50dd-6184-42f4-99c0-ddbe2f98619b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:10.525066 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-de2d50dd-6184-42f4-99c0-ddbe2f98619b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:10.526055 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-de2d50dd-6184-42f4-99c0-ddbe2f98619b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:10.526495 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-de2d50dd-6184-42f4-99c0-ddbe2f98619b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:10.902383 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-de2d50dd-6184-42f4-99c0-ddbe2f98619b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:10.925497 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-de2d50dd-6184-42f4-99c0-ddbe2f98619b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1321 microversion: 2.1 time: 0.412660 Jul 28 04:00:10.929007 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 59/97] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:10 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1321 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:10.934830 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-261f67b0-76b7-48b7-a7a4-4848853b3bd4 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:10.935646 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-261f67b0-76b7-48b7-a7a4-4848853b3bd4 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:10.947181 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-261f67b0-76b7-48b7-a7a4-4848853b3bd4 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:10.947637 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-261f67b0-76b7-48b7-a7a4-4848853b3bd4 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:10.948415 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-261f67b0-76b7-48b7-a7a4-4848853b3bd4 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:10.948851 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-261f67b0-76b7-48b7-a7a4-4848853b3bd4 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:11.005333 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-b4179321-0de6-4a43-b960-a91ffef93213 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:11.021217 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-b4179321-0de6-4a43-b960-a91ffef93213 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1367 microversion: 2.1 time: 0.901590 Jul 28 04:00:11.021809 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 39/98] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:10 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1367 bytes in 903 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:11.026267 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-8637c3db-84fb-4882-b0dc-001e885ad65a tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:11.026898 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-8637c3db-84fb-4882-b0dc-001e885ad65a tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:11.038606 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8637c3db-84fb-4882-b0dc-001e885ad65a tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:11.039092 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8637c3db-84fb-4882-b0dc-001e885ad65a tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:11.039868 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8637c3db-84fb-4882-b0dc-001e885ad65a tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:11.040310 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8637c3db-84fb-4882-b0dc-001e885ad65a tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:11.387142 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-8637c3db-84fb-4882-b0dc-001e885ad65a tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:11.399710 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-261f67b0-76b7-48b7-a7a4-4848853b3bd4 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:11.429281 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-8637c3db-84fb-4882-b0dc-001e885ad65a tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1293 microversion: 2.1 time: 0.405252 Jul 28 04:00:11.430024 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-261f67b0-76b7-48b7-a7a4-4848853b3bd4 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1315 microversion: 2.1 time: 0.497830 Jul 28 04:00:11.430903 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 60/99] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:10 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1315 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:11.432616 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 40/100] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:11 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1293 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:11.953702 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-cc10a4a0-b8b8-4cca-8c03-43eb3e953880 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:11.955207 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-cc10a4a0-b8b8-4cca-8c03-43eb3e953880 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:11.962276 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=6 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:11.967510 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cc10a4a0-b8b8-4cca-8c03-43eb3e953880 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:11.968200 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cc10a4a0-b8b8-4cca-8c03-43eb3e953880 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:11.968746 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cc10a4a0-b8b8-4cca-8c03-43eb3e953880 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:11.969711 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cc10a4a0-b8b8-4cca-8c03-43eb3e953880 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:12.043325 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-b476ab05-9e1e-409f-8c6d-55fc481028c9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:12.044155 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-b476ab05-9e1e-409f-8c6d-55fc481028c9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:12.055315 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b476ab05-9e1e-409f-8c6d-55fc481028c9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:12.055828 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b476ab05-9e1e-409f-8c6d-55fc481028c9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:12.056801 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b476ab05-9e1e-409f-8c6d-55fc481028c9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:12.057898 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b476ab05-9e1e-409f-8c6d-55fc481028c9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:12.342529 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-cc10a4a0-b8b8-4cca-8c03-43eb3e953880 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:12.373845 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-cc10a4a0-b8b8-4cca-8c03-43eb3e953880 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1321 microversion: 2.1 time: 0.422351 Jul 28 04:00:12.379112 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 61/101] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:11 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1321 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:12.393022 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-3996da93-2a61-44e8-8bac-603e861f9930 req-6d91318d-abe3-48b4-9318-07135984b1db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9103b14-a0f8-40f5-b38b-54b90cae2131", "tag": "cf1dd0bc-9549-4cae-9755-ef7ec478ee92"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:12.411862 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-3996da93-2a61-44e8-8bac-603e861f9930 req-6d91318d-abe3-48b4-9318-07135984b1db service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:12.412246 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-3996da93-2a61-44e8-8bac-603e861f9930 req-6d91318d-abe3-48b4-9318-07135984b1db service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:12.457687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-3996da93-2a61-44e8-8bac-603e861f9930 req-6d91318d-abe3-48b4-9318-07135984b1db service nova] Creating event network-changed:cf1dd0bc-9549-4cae-9755-ef7ec478ee92 for instance f9103b14-a0f8-40f5-b38b-54b90cae2131 on hv-cinder-79987 Jul 28 04:00:12.481003 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-3996da93-2a61-44e8-8bac-603e861f9930 req-6d91318d-abe3-48b4-9318-07135984b1db service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.100423 Jul 28 04:00:12.481916 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 62/102] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:12.487316 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-508f4649-d8b2-424a-ae4c-f0024f924dae tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:12.488017 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-508f4649-d8b2-424a-ae4c-f0024f924dae tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:12.506073 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-508f4649-d8b2-424a-ae4c-f0024f924dae tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:12.506547 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-508f4649-d8b2-424a-ae4c-f0024f924dae tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:12.507363 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-508f4649-d8b2-424a-ae4c-f0024f924dae tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:12.509679 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-508f4649-d8b2-424a-ae4c-f0024f924dae tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:12.571434 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=100 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:12.712310 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-b476ab05-9e1e-409f-8c6d-55fc481028c9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:12.727599 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-b476ab05-9e1e-409f-8c6d-55fc481028c9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1367 microversion: 2.1 time: 0.689974 Jul 28 04:00:12.735938 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 41/103] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:12 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1367 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:12.759854 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-8915d405-efd6-4fae-88e9-f01e9d7e886b tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:12.760916 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-8915d405-efd6-4fae-88e9-f01e9d7e886b tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:12.785716 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8915d405-efd6-4fae-88e9-f01e9d7e886b tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:12.789176 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8915d405-efd6-4fae-88e9-f01e9d7e886b tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:12.793028 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8915d405-efd6-4fae-88e9-f01e9d7e886b tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:12.794774 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8915d405-efd6-4fae-88e9-f01e9d7e886b tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:12.866589 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-508f4649-d8b2-424a-ae4c-f0024f924dae tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:12.882889 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-508f4649-d8b2-424a-ae4c-f0024f924dae tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1361 microversion: 2.1 time: 0.394743 Jul 28 04:00:12.884141 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 63/104] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:12 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1361 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:13.402124 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2a5fab78-874a-455a-b2d0-6c0d2964c7c0 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:13.402838 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-2a5fab78-874a-455a-b2d0-6c0d2964c7c0 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:13.414488 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2a5fab78-874a-455a-b2d0-6c0d2964c7c0 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:13.415354 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2a5fab78-874a-455a-b2d0-6c0d2964c7c0 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:13.419467 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2a5fab78-874a-455a-b2d0-6c0d2964c7c0 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:13.421362 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2a5fab78-874a-455a-b2d0-6c0d2964c7c0 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:13.746385 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-8915d405-efd6-4fae-88e9-f01e9d7e886b tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:13.760777 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-8915d405-efd6-4fae-88e9-f01e9d7e886b tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1315 microversion: 2.1 time: 1.023751 Jul 28 04:00:13.763472 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 42/105] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:12 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1315 bytes in 1027 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:13.776137 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-0b9b0cb5-a7a4-44b5-8394-ffb69178d3f6 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:13.779743 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-0b9b0cb5-a7a4-44b5-8394-ffb69178d3f6 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:13.790495 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0b9b0cb5-a7a4-44b5-8394-ffb69178d3f6 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:13.790971 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0b9b0cb5-a7a4-44b5-8394-ffb69178d3f6 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:13.798762 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0b9b0cb5-a7a4-44b5-8394-ffb69178d3f6 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:13.801883 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0b9b0cb5-a7a4-44b5-8394-ffb69178d3f6 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:14.028920 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-2a5fab78-874a-455a-b2d0-6c0d2964c7c0 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:14.041371 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-2a5fab78-874a-455a-b2d0-6c0d2964c7c0 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1321 microversion: 2.1 time: 0.641210 Jul 28 04:00:14.046078 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 64/106] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:13 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1321 bytes in 649 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:14.055814 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b5b31d93-43cb-445a-a265-177c646a64bf tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:14.056756 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b5b31d93-43cb-445a-a265-177c646a64bf tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:14.073808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b5b31d93-43cb-445a-a265-177c646a64bf tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:14.074960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b5b31d93-43cb-445a-a265-177c646a64bf tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:14.077849 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b5b31d93-43cb-445a-a265-177c646a64bf tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:14.079960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b5b31d93-43cb-445a-a265-177c646a64bf tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:14.567310 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b5b31d93-43cb-445a-a265-177c646a64bf tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:14.576960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b5b31d93-43cb-445a-a265-177c646a64bf tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1361 microversion: 2.1 time: 0.529357 Jul 28 04:00:14.579949 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 65/107] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:14 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1361 bytes in 533 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:14.598341 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-a7c42d16-dde6-4d65-887e-4f7e5e0b08ae req-3e747026-a236-4f9d-87a5-51c48dab2e29 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beb705c5-be1c-471d-82d9-b6d699ead475", "tag": "bcfe84f6-7f7b-4876-8b26-9916056e7600"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:14.616215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-a7c42d16-dde6-4d65-887e-4f7e5e0b08ae req-3e747026-a236-4f9d-87a5-51c48dab2e29 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:14.616943 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-a7c42d16-dde6-4d65-887e-4f7e5e0b08ae req-3e747026-a236-4f9d-87a5-51c48dab2e29 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:14.644999 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-a7c42d16-dde6-4d65-887e-4f7e5e0b08ae req-3e747026-a236-4f9d-87a5-51c48dab2e29 service nova] Creating event network-changed:bcfe84f6-7f7b-4876-8b26-9916056e7600 for instance beb705c5-be1c-471d-82d9-b6d699ead475 on hv-cinder-79987 Jul 28 04:00:14.651206 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-a7c42d16-dde6-4d65-887e-4f7e5e0b08ae req-3e747026-a236-4f9d-87a5-51c48dab2e29 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069799 Jul 28 04:00:14.651823 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 66/108] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:14.674262 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-171d8ba1-48e7-4c90-a501-ab1da1cba8b2 req-0e04d5b2-6164-4d8b-a5d9-3c8fcb81fe13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b9e96863-0e05-4ac4-ba31-95db87337440", "tag": "e0bdfff3-ee6f-494e-a567-0b6b2b62131c"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:14.694893 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-171d8ba1-48e7-4c90-a501-ab1da1cba8b2 req-0e04d5b2-6164-4d8b-a5d9-3c8fcb81fe13 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:14.695325 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-171d8ba1-48e7-4c90-a501-ab1da1cba8b2 req-0e04d5b2-6164-4d8b-a5d9-3c8fcb81fe13 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:14.741092 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-171d8ba1-48e7-4c90-a501-ab1da1cba8b2 req-0e04d5b2-6164-4d8b-a5d9-3c8fcb81fe13 service nova] Creating event network-changed:e0bdfff3-ee6f-494e-a567-0b6b2b62131c for instance b9e96863-0e05-4ac4-ba31-95db87337440 on hv-cinder-79987 Jul 28 04:00:14.754916 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-171d8ba1-48e7-4c90-a501-ab1da1cba8b2 req-0e04d5b2-6164-4d8b-a5d9-3c8fcb81fe13 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.101522 Jul 28 04:00:14.755912 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 67/109] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:00:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:14.790755 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d7b09fd1-61c8-4059-bd6c-27693b0c1748 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:14.791505 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d7b09fd1-61c8-4059-bd6c-27693b0c1748 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:14.805357 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d7b09fd1-61c8-4059-bd6c-27693b0c1748 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:14.805808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d7b09fd1-61c8-4059-bd6c-27693b0c1748 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:14.806589 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d7b09fd1-61c8-4059-bd6c-27693b0c1748 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:14.807051 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d7b09fd1-61c8-4059-bd6c-27693b0c1748 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:15.104542 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-0b9b0cb5-a7a4-44b5-8394-ffb69178d3f6 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:15.114736 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-0b9b0cb5-a7a4-44b5-8394-ffb69178d3f6 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1367 microversion: 2.1 time: 1.347148 Jul 28 04:00:15.121766 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 43/110] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:13 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1367 bytes in 1356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:15.136306 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-fe354dc4-fc85-4b79-b73f-3f8ffc6ce8b9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:15.137382 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-fe354dc4-fc85-4b79-b73f-3f8ffc6ce8b9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:15.153697 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fe354dc4-fc85-4b79-b73f-3f8ffc6ce8b9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:15.156509 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fe354dc4-fc85-4b79-b73f-3f8ffc6ce8b9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:15.158124 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fe354dc4-fc85-4b79-b73f-3f8ffc6ce8b9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:15.160462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fe354dc4-fc85-4b79-b73f-3f8ffc6ce8b9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:15.623323 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-fe354dc4-fc85-4b79-b73f-3f8ffc6ce8b9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:15.633250 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-fe354dc4-fc85-4b79-b73f-3f8ffc6ce8b9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1321 microversion: 2.1 time: 0.510017 Jul 28 04:00:15.634117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 44/111] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:15 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1321 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:15.662692 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d7b09fd1-61c8-4059-bd6c-27693b0c1748 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:15.676053 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d7b09fd1-61c8-4059-bd6c-27693b0c1748 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1315 microversion: 2.1 time: 0.889938 Jul 28 04:00:15.679757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 68/112] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:14 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1315 bytes in 895 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:15.689118 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d880b3de-634b-4276-84ff-b9330f0ea890 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:15.693039 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d880b3de-634b-4276-84ff-b9330f0ea890 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:15.705897 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d880b3de-634b-4276-84ff-b9330f0ea890 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:15.706361 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d880b3de-634b-4276-84ff-b9330f0ea890 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:15.711665 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d880b3de-634b-4276-84ff-b9330f0ea890 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:15.712316 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d880b3de-634b-4276-84ff-b9330f0ea890 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:15.755462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-b4c1be37-7e37-40c4-a7cb-31fa2064e510 req-f147fa86-3378-4418-9844-cd4bc831f5ad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f962971f-7600-40e0-9c46-257d1aa54ec0", "name": "network-vif-plugged", "status": "completed", "tag": "69a10956-82b0-477c-a7f6-0a2b2734d31e"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:15.774684 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-b4c1be37-7e37-40c4-a7cb-31fa2064e510 req-f147fa86-3378-4418-9844-cd4bc831f5ad service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:15.775162 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-b4c1be37-7e37-40c4-a7cb-31fa2064e510 req-f147fa86-3378-4418-9844-cd4bc831f5ad service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:15.787463 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-b4c1be37-7e37-40c4-a7cb-31fa2064e510 req-f147fa86-3378-4418-9844-cd4bc831f5ad service nova] Creating event network-vif-plugged:69a10956-82b0-477c-a7f6-0a2b2734d31e for instance f962971f-7600-40e0-9c46-257d1aa54ec0 on hv-cinder-79987 Jul 28 04:00:15.792695 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-b4c1be37-7e37-40c4-a7cb-31fa2064e510 req-f147fa86-3378-4418-9844-cd4bc831f5ad service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.157222 Jul 28 04:00:15.793696 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 45/113] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:00:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:15.918516 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d880b3de-634b-4276-84ff-b9330f0ea890 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:15.927131 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d880b3de-634b-4276-84ff-b9330f0ea890 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1361 microversion: 2.1 time: 0.245452 Jul 28 04:00:15.928308 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 69/114] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:15 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1361 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:16.145257 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a03d4dda-99b5-492b-9384-fa227ab4d4ad tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:16.146007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-a03d4dda-99b5-492b-9384-fa227ab4d4ad tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:16.152559 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a03d4dda-99b5-492b-9384-fa227ab4d4ad tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:16.153011 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a03d4dda-99b5-492b-9384-fa227ab4d4ad tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:16.153770 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a03d4dda-99b5-492b-9384-fa227ab4d4ad tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:16.154206 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a03d4dda-99b5-492b-9384-fa227ab4d4ad tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:16.285017 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-a03d4dda-99b5-492b-9384-fa227ab4d4ad tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:16.292699 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-a03d4dda-99b5-492b-9384-fa227ab4d4ad tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1367 microversion: 2.1 time: 0.152737 Jul 28 04:00:16.293273 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 46/115] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:16 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:16.658134 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-028ef376-3c19-4f03-b2f9-66a12832bc60 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:16.658657 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-028ef376-3c19-4f03-b2f9-66a12832bc60 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:16.666338 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-028ef376-3c19-4f03-b2f9-66a12832bc60 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:16.666912 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-028ef376-3c19-4f03-b2f9-66a12832bc60 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:16.667600 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-028ef376-3c19-4f03-b2f9-66a12832bc60 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:16.668039 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-028ef376-3c19-4f03-b2f9-66a12832bc60 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:16.705930 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-e02abc8d-6b87-406d-bba3-56cdd6c9725c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:16.706713 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-e02abc8d-6b87-406d-bba3-56cdd6c9725c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:16.713927 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e02abc8d-6b87-406d-bba3-56cdd6c9725c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:16.714374 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e02abc8d-6b87-406d-bba3-56cdd6c9725c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:16.715285 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e02abc8d-6b87-406d-bba3-56cdd6c9725c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:16.715888 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e02abc8d-6b87-406d-bba3-56cdd6c9725c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:16.823781 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-028ef376-3c19-4f03-b2f9-66a12832bc60 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:16.834637 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-028ef376-3c19-4f03-b2f9-66a12832bc60 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1321 microversion: 2.1 time: 0.182722 Jul 28 04:00:16.835363 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 70/116] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:16 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:16.885557 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-e02abc8d-6b87-406d-bba3-56cdd6c9725c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:16.893941 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-e02abc8d-6b87-406d-bba3-56cdd6c9725c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1315 microversion: 2.1 time: 0.192264 Jul 28 04:00:16.894524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 47/117] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:16 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:16.949961 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9dcd9c3c-2992-4658-abec-1a41d0b81a3d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:16.950572 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9dcd9c3c-2992-4658-abec-1a41d0b81a3d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:16.957324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9dcd9c3c-2992-4658-abec-1a41d0b81a3d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:16.957771 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9dcd9c3c-2992-4658-abec-1a41d0b81a3d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:16.958560 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9dcd9c3c-2992-4658-abec-1a41d0b81a3d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:16.959093 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9dcd9c3c-2992-4658-abec-1a41d0b81a3d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:17.088999 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9dcd9c3c-2992-4658-abec-1a41d0b81a3d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:17.099144 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9dcd9c3c-2992-4658-abec-1a41d0b81a3d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1361 microversion: 2.1 time: 0.152829 Jul 28 04:00:17.099722 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 71/118] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:16 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:17.314119 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c97473e7-3cb8-4502-b38b-fbb55d5ab7ac tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:17.314736 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c97473e7-3cb8-4502-b38b-fbb55d5ab7ac tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:17.321459 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c97473e7-3cb8-4502-b38b-fbb55d5ab7ac tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:17.321910 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c97473e7-3cb8-4502-b38b-fbb55d5ab7ac tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:17.322677 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c97473e7-3cb8-4502-b38b-fbb55d5ab7ac tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:17.323132 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c97473e7-3cb8-4502-b38b-fbb55d5ab7ac tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:17.456036 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-c97473e7-3cb8-4502-b38b-fbb55d5ab7ac tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:17.463520 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-c97473e7-3cb8-4502-b38b-fbb55d5ab7ac tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1367 microversion: 2.1 time: 0.153856 Jul 28 04:00:17.464088 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 48/119] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:17 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:17.855923 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-25b3665e-4644-4f55-aeab-f5d93b9feb3a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:17.856551 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-25b3665e-4644-4f55-aeab-f5d93b9feb3a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:17.863207 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-25b3665e-4644-4f55-aeab-f5d93b9feb3a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:17.863851 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-25b3665e-4644-4f55-aeab-f5d93b9feb3a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:17.864967 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-25b3665e-4644-4f55-aeab-f5d93b9feb3a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:17.865556 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-25b3665e-4644-4f55-aeab-f5d93b9feb3a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:17.916494 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-515cac01-47f0-4428-8340-7be31c68977a tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:17.917335 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-515cac01-47f0-4428-8340-7be31c68977a tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:17.925095 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-515cac01-47f0-4428-8340-7be31c68977a tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:17.926011 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-515cac01-47f0-4428-8340-7be31c68977a tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:17.927087 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-515cac01-47f0-4428-8340-7be31c68977a tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:17.927685 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-515cac01-47f0-4428-8340-7be31c68977a tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:18.019122 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-25b3665e-4644-4f55-aeab-f5d93b9feb3a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:18.027522 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-25b3665e-4644-4f55-aeab-f5d93b9feb3a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1321 microversion: 2.1 time: 0.175653 Jul 28 04:00:18.028522 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 72/120] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:17 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:18.089412 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-515cac01-47f0-4428-8340-7be31c68977a tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:18.097750 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-515cac01-47f0-4428-8340-7be31c68977a tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1315 microversion: 2.1 time: 0.186124 Jul 28 04:00:18.098509 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 49/121] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:17 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1315 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:18.119761 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d20a2774-12f5-413a-8aa8-dc298179e5b1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:18.120396 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d20a2774-12f5-413a-8aa8-dc298179e5b1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:18.126452 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d20a2774-12f5-413a-8aa8-dc298179e5b1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:18.126946 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d20a2774-12f5-413a-8aa8-dc298179e5b1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:18.127711 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d20a2774-12f5-413a-8aa8-dc298179e5b1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:18.128149 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d20a2774-12f5-413a-8aa8-dc298179e5b1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:18.275230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d20a2774-12f5-413a-8aa8-dc298179e5b1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:18.283604 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d20a2774-12f5-413a-8aa8-dc298179e5b1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1361 microversion: 2.1 time: 0.167554 Jul 28 04:00:18.284056 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 73/122] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:18 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:18.484002 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-170a2cc9-f179-4f4c-9201-d91488e4f841 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:18.485244 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-170a2cc9-f179-4f4c-9201-d91488e4f841 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:18.492244 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-170a2cc9-f179-4f4c-9201-d91488e4f841 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:18.492783 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-170a2cc9-f179-4f4c-9201-d91488e4f841 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:18.493814 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-170a2cc9-f179-4f4c-9201-d91488e4f841 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:18.494756 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-170a2cc9-f179-4f4c-9201-d91488e4f841 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:18.513014 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=100 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:18.635384 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-170a2cc9-f179-4f4c-9201-d91488e4f841 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:18.645296 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-170a2cc9-f179-4f4c-9201-d91488e4f841 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1367 microversion: 2.1 time: 0.165050 Jul 28 04:00:18.646051 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 50/123] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:18 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:19.050117 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-732760b3-cf0a-4c03-b57e-d1958446df00 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:19.050735 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-732760b3-cf0a-4c03-b57e-d1958446df00 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:19.056739 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-732760b3-cf0a-4c03-b57e-d1958446df00 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:19.057190 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-732760b3-cf0a-4c03-b57e-d1958446df00 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:19.057947 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-732760b3-cf0a-4c03-b57e-d1958446df00 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:19.058379 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-732760b3-cf0a-4c03-b57e-d1958446df00 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:19.119886 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-4e243da2-d15a-45ad-a832-b2e86de47435 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:19.120796 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-4e243da2-d15a-45ad-a832-b2e86de47435 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:19.127667 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4e243da2-d15a-45ad-a832-b2e86de47435 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:19.128119 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4e243da2-d15a-45ad-a832-b2e86de47435 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:19.129085 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4e243da2-d15a-45ad-a832-b2e86de47435 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:19.129515 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4e243da2-d15a-45ad-a832-b2e86de47435 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:19.196023 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-732760b3-cf0a-4c03-b57e-d1958446df00 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:19.204486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-732760b3-cf0a-4c03-b57e-d1958446df00 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1321 microversion: 2.1 time: 0.158759 Jul 28 04:00:19.205203 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 74/124] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:19 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1321 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:19.283243 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-4e243da2-d15a-45ad-a832-b2e86de47435 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:19.290835 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-4e243da2-d15a-45ad-a832-b2e86de47435 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1315 microversion: 2.1 time: 0.175642 Jul 28 04:00:19.291400 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 51/125] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:19 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:19.305742 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5317ce56-0d71-4806-b2b1-f9c9d5a9c106 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:19.306291 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5317ce56-0d71-4806-b2b1-f9c9d5a9c106 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:19.312685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5317ce56-0d71-4806-b2b1-f9c9d5a9c106 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:19.313322 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5317ce56-0d71-4806-b2b1-f9c9d5a9c106 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:19.314077 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5317ce56-0d71-4806-b2b1-f9c9d5a9c106 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:19.314660 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5317ce56-0d71-4806-b2b1-f9c9d5a9c106 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:19.446973 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5317ce56-0d71-4806-b2b1-f9c9d5a9c106 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:19.455608 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5317ce56-0d71-4806-b2b1-f9c9d5a9c106 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1361 microversion: 2.1 time: 0.154631 Jul 28 04:00:19.456173 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 75/126] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:19 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1361 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:19.666032 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-2565cf9f-da65-4257-998a-1631cc314f0b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:19.667292 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-2565cf9f-da65-4257-998a-1631cc314f0b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:19.674365 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2565cf9f-da65-4257-998a-1631cc314f0b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:19.675105 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2565cf9f-da65-4257-998a-1631cc314f0b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:19.675951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2565cf9f-da65-4257-998a-1631cc314f0b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:19.676454 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2565cf9f-da65-4257-998a-1631cc314f0b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:19.832113 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-2565cf9f-da65-4257-998a-1631cc314f0b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:19.841333 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-2565cf9f-da65-4257-998a-1631cc314f0b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1367 microversion: 2.1 time: 0.179549 Jul 28 04:00:19.841911 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 52/127] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:19 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:20.240518 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-cdf3f801-822b-445b-a5b1-febcf555138a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:20.241162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-cdf3f801-822b-445b-a5b1-febcf555138a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:20.249630 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cdf3f801-822b-445b-a5b1-febcf555138a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:20.250979 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cdf3f801-822b-445b-a5b1-febcf555138a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:20.251758 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cdf3f801-822b-445b-a5b1-febcf555138a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:20.252440 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cdf3f801-822b-445b-a5b1-febcf555138a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:20.316719 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-b28959d4-3ec1-4d6a-8aec-acd01ee7403c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:20.318078 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-b28959d4-3ec1-4d6a-8aec-acd01ee7403c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:20.334560 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b28959d4-3ec1-4d6a-8aec-acd01ee7403c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:20.335120 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b28959d4-3ec1-4d6a-8aec-acd01ee7403c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:20.336094 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b28959d4-3ec1-4d6a-8aec-acd01ee7403c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:20.336518 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b28959d4-3ec1-4d6a-8aec-acd01ee7403c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:20.465312 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-cdf3f801-822b-445b-a5b1-febcf555138a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:20.478658 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-cdf3f801-822b-445b-a5b1-febcf555138a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1321 microversion: 2.1 time: 0.256606 Jul 28 04:00:20.486898 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 76/128] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:20 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1321 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:20.493284 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-67c1c46e-9748-4dc1-98ef-e391960d4af1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:20.494099 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-67c1c46e-9748-4dc1-98ef-e391960d4af1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:20.519318 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-67c1c46e-9748-4dc1-98ef-e391960d4af1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:20.523583 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-67c1c46e-9748-4dc1-98ef-e391960d4af1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:20.543662 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-67c1c46e-9748-4dc1-98ef-e391960d4af1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:20.544252 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-67c1c46e-9748-4dc1-98ef-e391960d4af1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:20.946993 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-67c1c46e-9748-4dc1-98ef-e391960d4af1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:20.955381 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-67c1c46e-9748-4dc1-98ef-e391960d4af1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1361 microversion: 2.1 time: 0.467192 Jul 28 04:00:20.956179 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 77/129] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:20 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1361 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:20.969216 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-06ea20ea-c170-4e12-bc38-49ca992bef7b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:20.970960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-06ea20ea-c170-4e12-bc38-49ca992bef7b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:20.977853 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-06ea20ea-c170-4e12-bc38-49ca992bef7b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:20.978703 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-06ea20ea-c170-4e12-bc38-49ca992bef7b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:20.979687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-06ea20ea-c170-4e12-bc38-49ca992bef7b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:20.980306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-06ea20ea-c170-4e12-bc38-49ca992bef7b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:21.123407 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-b28959d4-3ec1-4d6a-8aec-acd01ee7403c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:21.136697 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-b28959d4-3ec1-4d6a-8aec-acd01ee7403c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1315 microversion: 2.1 time: 0.823302 Jul 28 04:00:21.150892 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 53/130] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:20 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1315 bytes in 829 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:21.298181 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-06ea20ea-c170-4e12-bc38-49ca992bef7b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:21.309897 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-06ea20ea-c170-4e12-bc38-49ca992bef7b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1367 microversion: 2.1 time: 0.352472 Jul 28 04:00:21.312110 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 78/131] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:20 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1367 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:21.327045 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-febeb996-5f1e-408b-840d-5735db35c6aa req-6a932ebd-8100-49e5-b9cf-29bd25d0d7d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54fdcaaa-031e-4509-b8a7-6b284460c7d2", "name": "network-vif-plugged", "status": "completed", "tag": "a3fa56f4-0f47-422c-8d08-1b8073aa9acc"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:21.345442 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-febeb996-5f1e-408b-840d-5735db35c6aa req-6a932ebd-8100-49e5-b9cf-29bd25d0d7d8 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:21.347045 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-febeb996-5f1e-408b-840d-5735db35c6aa req-6a932ebd-8100-49e5-b9cf-29bd25d0d7d8 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:21.371761 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-febeb996-5f1e-408b-840d-5735db35c6aa req-6a932ebd-8100-49e5-b9cf-29bd25d0d7d8 service nova] Creating event network-vif-plugged:a3fa56f4-0f47-422c-8d08-1b8073aa9acc for instance 54fdcaaa-031e-4509-b8a7-6b284460c7d2 on hv-cinder-79987 Jul 28 04:00:21.379265 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-febeb996-5f1e-408b-840d-5735db35c6aa req-6a932ebd-8100-49e5-b9cf-29bd25d0d7d8 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059565 Jul 28 04:00:21.380811 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 54/132] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:21.508215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-28dce222-889d-4b04-b7f3-889f7876f0e1 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:21.509002 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-28dce222-889d-4b04-b7f3-889f7876f0e1 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:21.521823 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-28dce222-889d-4b04-b7f3-889f7876f0e1 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:21.527898 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-28dce222-889d-4b04-b7f3-889f7876f0e1 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:21.528733 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-28dce222-889d-4b04-b7f3-889f7876f0e1 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:21.529177 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-28dce222-889d-4b04-b7f3-889f7876f0e1 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:21.751810 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-28dce222-889d-4b04-b7f3-889f7876f0e1 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:21.764301 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-28dce222-889d-4b04-b7f3-889f7876f0e1 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1321 microversion: 2.1 time: 0.260673 Jul 28 04:00:21.777549 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 79/133] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:21 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1321 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:21.978137 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-32a6e93e-e1d2-4700-b659-b65d3918db26 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:21.979534 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-32a6e93e-e1d2-4700-b659-b65d3918db26 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:21.987753 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-32a6e93e-e1d2-4700-b659-b65d3918db26 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:21.988197 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-32a6e93e-e1d2-4700-b659-b65d3918db26 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:21.988954 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-32a6e93e-e1d2-4700-b659-b65d3918db26 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:21.989825 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-32a6e93e-e1d2-4700-b659-b65d3918db26 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:22.163993 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-068d131a-98d0-4b82-8bf7-b64e53c78a8e tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:22.164980 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-068d131a-98d0-4b82-8bf7-b64e53c78a8e tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:22.179311 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-068d131a-98d0-4b82-8bf7-b64e53c78a8e tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:22.179311 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-068d131a-98d0-4b82-8bf7-b64e53c78a8e tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:22.179311 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-068d131a-98d0-4b82-8bf7-b64e53c78a8e tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:22.179311 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-068d131a-98d0-4b82-8bf7-b64e53c78a8e tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:22.213692 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-32a6e93e-e1d2-4700-b659-b65d3918db26 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:22.218603 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-32a6e93e-e1d2-4700-b659-b65d3918db26 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1361 microversion: 2.1 time: 0.244659 Jul 28 04:00:22.219855 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 55/134] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:21 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1361 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:22.340742 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-9a8ac64d-5361-4eda-9e0d-e71d59a3dbc9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:22.342317 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-9a8ac64d-5361-4eda-9e0d-e71d59a3dbc9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:22.349888 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9a8ac64d-5361-4eda-9e0d-e71d59a3dbc9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:22.350711 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9a8ac64d-5361-4eda-9e0d-e71d59a3dbc9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:22.351657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9a8ac64d-5361-4eda-9e0d-e71d59a3dbc9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:22.352408 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9a8ac64d-5361-4eda-9e0d-e71d59a3dbc9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:22.424746 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-068d131a-98d0-4b82-8bf7-b64e53c78a8e tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:22.439508 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-068d131a-98d0-4b82-8bf7-b64e53c78a8e tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1315 microversion: 2.1 time: 0.279672 Jul 28 04:00:22.440645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 80/135] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:22 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1315 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:22.702700 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-9a8ac64d-5361-4eda-9e0d-e71d59a3dbc9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:22.715341 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-9a8ac64d-5361-4eda-9e0d-e71d59a3dbc9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1367 microversion: 2.1 time: 0.382777 Jul 28 04:00:22.716133 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 56/136] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:22 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1367 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:22.785579 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-bcb2ef52-0c23-47d5-aeb9-37f42d67006e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:22.786198 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-bcb2ef52-0c23-47d5-aeb9-37f42d67006e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:22.792536 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bcb2ef52-0c23-47d5-aeb9-37f42d67006e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:22.792991 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bcb2ef52-0c23-47d5-aeb9-37f42d67006e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:22.793754 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bcb2ef52-0c23-47d5-aeb9-37f42d67006e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:22.794192 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bcb2ef52-0c23-47d5-aeb9-37f42d67006e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:22.813506 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=100 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:22.935177 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-bcb2ef52-0c23-47d5-aeb9-37f42d67006e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:22.942523 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-bcb2ef52-0c23-47d5-aeb9-37f42d67006e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1321 microversion: 2.1 time: 0.161355 Jul 28 04:00:22.943125 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 81/137] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:22 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:23.240512 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-f8e2cd66-3733-43db-9f84-615d79e91dd5 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:23.241020 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-f8e2cd66-3733-43db-9f84-615d79e91dd5 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:23.247314 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f8e2cd66-3733-43db-9f84-615d79e91dd5 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:23.247776 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f8e2cd66-3733-43db-9f84-615d79e91dd5 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:23.248552 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f8e2cd66-3733-43db-9f84-615d79e91dd5 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:23.248991 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f8e2cd66-3733-43db-9f84-615d79e91dd5 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:23.385334 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-f8e2cd66-3733-43db-9f84-615d79e91dd5 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:23.393898 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-f8e2cd66-3733-43db-9f84-615d79e91dd5 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1361 microversion: 2.1 time: 0.157250 Jul 28 04:00:23.394487 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 57/138] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:23 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:23.459625 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3bf78db8-50b0-4d70-bbe5-bad541c7f733 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:23.460391 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3bf78db8-50b0-4d70-bbe5-bad541c7f733 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:23.467488 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3bf78db8-50b0-4d70-bbe5-bad541c7f733 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:23.467936 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3bf78db8-50b0-4d70-bbe5-bad541c7f733 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:23.472208 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3bf78db8-50b0-4d70-bbe5-bad541c7f733 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:23.472655 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3bf78db8-50b0-4d70-bbe5-bad541c7f733 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:23.674554 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-5397bb04-39c7-46ae-9be9-dcae3e0ba840 req-478b7473-7647-4d87-8c5c-30b32e40a7a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e96863-0e05-4ac4-ba31-95db87337440", "name": "network-vif-plugged", "status": "completed", "tag": "e0bdfff3-ee6f-494e-a567-0b6b2b62131c"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:23.678886 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3bf78db8-50b0-4d70-bbe5-bad541c7f733 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:23.688330 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3bf78db8-50b0-4d70-bbe5-bad541c7f733 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1315 microversion: 2.1 time: 0.232421 Jul 28 04:00:23.689080 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 82/139] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:23 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:23.696755 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-5397bb04-39c7-46ae-9be9-dcae3e0ba840 req-478b7473-7647-4d87-8c5c-30b32e40a7a2 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:23.698477 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-5397bb04-39c7-46ae-9be9-dcae3e0ba840 req-478b7473-7647-4d87-8c5c-30b32e40a7a2 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:23.720430 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-5397bb04-39c7-46ae-9be9-dcae3e0ba840 req-478b7473-7647-4d87-8c5c-30b32e40a7a2 service nova] Creating event network-vif-plugged:e0bdfff3-ee6f-494e-a567-0b6b2b62131c for instance b9e96863-0e05-4ac4-ba31-95db87337440 on hv-cinder-79987 Jul 28 04:00:23.739601 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-5397bb04-39c7-46ae-9be9-dcae3e0ba840 req-478b7473-7647-4d87-8c5c-30b32e40a7a2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069808 Jul 28 04:00:23.744258 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ff2adf18-afb0-45c8-960d-1c0c1dc5e6b4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:23.744991 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 58/140] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:00:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:23.745442 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ff2adf18-afb0-45c8-960d-1c0c1dc5e6b4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:23.755256 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ff2adf18-afb0-45c8-960d-1c0c1dc5e6b4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:23.755256 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ff2adf18-afb0-45c8-960d-1c0c1dc5e6b4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:23.755256 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ff2adf18-afb0-45c8-960d-1c0c1dc5e6b4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:23.755708 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ff2adf18-afb0-45c8-960d-1c0c1dc5e6b4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:23.964717 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-0e3d7333-7576-44d1-8796-055fe874e345 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:23.965552 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-0e3d7333-7576-44d1-8796-055fe874e345 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:23.976097 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0e3d7333-7576-44d1-8796-055fe874e345 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:23.977640 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0e3d7333-7576-44d1-8796-055fe874e345 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:23.979026 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0e3d7333-7576-44d1-8796-055fe874e345 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:23.981430 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0e3d7333-7576-44d1-8796-055fe874e345 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:24.021958 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ff2adf18-afb0-45c8-960d-1c0c1dc5e6b4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:24.032802 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ff2adf18-afb0-45c8-960d-1c0c1dc5e6b4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1367 microversion: 2.1 time: 0.297873 Jul 28 04:00:24.033517 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 83/141] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:23 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:24.414871 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-933a9133-4ce7-442a-89b9-07b8235a738c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:24.415696 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-933a9133-4ce7-442a-89b9-07b8235a738c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:24.422388 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-933a9133-4ce7-442a-89b9-07b8235a738c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:24.422923 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-933a9133-4ce7-442a-89b9-07b8235a738c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:24.423916 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-933a9133-4ce7-442a-89b9-07b8235a738c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:24.424496 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-933a9133-4ce7-442a-89b9-07b8235a738c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:24.513458 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-0e3d7333-7576-44d1-8796-055fe874e345 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:24.521212 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-0e3d7333-7576-44d1-8796-055fe874e345 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1321 microversion: 2.1 time: 0.560831 Jul 28 04:00:24.522009 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 59/142] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:23 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1321 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:24.601908 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-933a9133-4ce7-442a-89b9-07b8235a738c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:24.612093 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-933a9133-4ce7-442a-89b9-07b8235a738c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1361 microversion: 2.1 time: 0.201182 Jul 28 04:00:24.612899 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 84/143] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:24 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1361 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:24.709716 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-b62ba9f8-ee7f-45ee-b8fd-1ee87fb03005 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:24.710341 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-b62ba9f8-ee7f-45ee-b8fd-1ee87fb03005 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:24.721634 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b62ba9f8-ee7f-45ee-b8fd-1ee87fb03005 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:24.722330 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b62ba9f8-ee7f-45ee-b8fd-1ee87fb03005 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:24.723329 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b62ba9f8-ee7f-45ee-b8fd-1ee87fb03005 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:24.723918 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b62ba9f8-ee7f-45ee-b8fd-1ee87fb03005 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:24.995635 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-b62ba9f8-ee7f-45ee-b8fd-1ee87fb03005 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:25.006432 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-b62ba9f8-ee7f-45ee-b8fd-1ee87fb03005 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1502 microversion: 2.1 time: 0.299758 Jul 28 04:00:25.007182 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 60/144] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:24 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1502 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:25.053599 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-52f56ba0-6895-40ba-9c68-e7c0f68ba97f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:25.054589 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-52f56ba0-6895-40ba-9c68-e7c0f68ba97f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:25.061549 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-52f56ba0-6895-40ba-9c68-e7c0f68ba97f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:25.062395 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-52f56ba0-6895-40ba-9c68-e7c0f68ba97f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:25.063344 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-52f56ba0-6895-40ba-9c68-e7c0f68ba97f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:25.064022 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-52f56ba0-6895-40ba-9c68-e7c0f68ba97f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:25.543786 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-3fcb7981-8da0-4b5d-b3db-fd6396a32fe6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:25.544405 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-3fcb7981-8da0-4b5d-b3db-fd6396a32fe6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:25.560871 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3fcb7981-8da0-4b5d-b3db-fd6396a32fe6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:25.561350 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3fcb7981-8da0-4b5d-b3db-fd6396a32fe6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:25.562152 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3fcb7981-8da0-4b5d-b3db-fd6396a32fe6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:25.563291 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3fcb7981-8da0-4b5d-b3db-fd6396a32fe6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:25.714725 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-52f56ba0-6895-40ba-9c68-e7c0f68ba97f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:25.724463 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-52f56ba0-6895-40ba-9c68-e7c0f68ba97f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1367 microversion: 2.1 time: 0.674558 Jul 28 04:00:25.740212 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 85/145] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:25 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1367 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:25.748875 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b9ecd8d9-689c-49c6-b033-7c2b4211dc41 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:25.749713 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b9ecd8d9-689c-49c6-b033-7c2b4211dc41 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:25.756763 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b9ecd8d9-689c-49c6-b033-7c2b4211dc41 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:25.757486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b9ecd8d9-689c-49c6-b033-7c2b4211dc41 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:25.758559 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b9ecd8d9-689c-49c6-b033-7c2b4211dc41 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:25.759186 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b9ecd8d9-689c-49c6-b033-7c2b4211dc41 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:25.830541 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-3fcb7981-8da0-4b5d-b3db-fd6396a32fe6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:25.841647 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-3fcb7981-8da0-4b5d-b3db-fd6396a32fe6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1321 microversion: 2.1 time: 0.299454 Jul 28 04:00:25.843407 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 61/146] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:25 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1321 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:25.901533 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-8fb732e4-0680-49f7-a1a2-9363063349b5 req-b3359c43-db70-4069-83fc-b02a499c05fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beb705c5-be1c-471d-82d9-b6d699ead475", "name": "network-vif-plugged", "status": "completed", "tag": "bcfe84f6-7f7b-4876-8b26-9916056e7600"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:25.925744 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-8fb732e4-0680-49f7-a1a2-9363063349b5 req-b3359c43-db70-4069-83fc-b02a499c05fa service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:25.926408 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-8fb732e4-0680-49f7-a1a2-9363063349b5 req-b3359c43-db70-4069-83fc-b02a499c05fa service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:25.948528 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-8fb732e4-0680-49f7-a1a2-9363063349b5 req-b3359c43-db70-4069-83fc-b02a499c05fa service nova] Creating event network-vif-plugged:bcfe84f6-7f7b-4876-8b26-9916056e7600 for instance beb705c5-be1c-471d-82d9-b6d699ead475 on hv-cinder-79987 Jul 28 04:00:25.954739 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-8fb732e4-0680-49f7-a1a2-9363063349b5 req-b3359c43-db70-4069-83fc-b02a499c05fa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056230 Jul 28 04:00:25.955716 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 62/147] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:26.053754 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b9ecd8d9-689c-49c6-b033-7c2b4211dc41 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:26.068057 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b9ecd8d9-689c-49c6-b033-7c2b4211dc41 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1361 microversion: 2.1 time: 0.326230 Jul 28 04:00:26.069967 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 86/148] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:25 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1361 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:26.513548 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-12dd9d0d-9330-4718-ac10-77aea7670617 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6d3729e9-018f-4c41-b9ab-62f3acb38f78"}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:26.517217 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-12dd9d0d-9330-4718-ac10-77aea7670617 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:26.526290 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-12dd9d0d-9330-4718-ac10-77aea7670617 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:26.526703 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-12dd9d0d-9330-4718-ac10-77aea7670617 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:26.527852 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-12dd9d0d-9330-4718-ac10-77aea7670617 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:26.528673 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-12dd9d0d-9330-4718-ac10-77aea7670617 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:26.752332 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2d79c85a-0d45-4d36-94cc-5db9b1307e3f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:26.752957 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-2d79c85a-0d45-4d36-94cc-5db9b1307e3f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:26.760697 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2d79c85a-0d45-4d36-94cc-5db9b1307e3f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:26.761660 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2d79c85a-0d45-4d36-94cc-5db9b1307e3f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:26.762674 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2d79c85a-0d45-4d36-94cc-5db9b1307e3f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:26.763462 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2d79c85a-0d45-4d36-94cc-5db9b1307e3f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:26.987927 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-12dd9d0d-9330-4718-ac10-77aea7670617 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "POST /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.480963 Jul 28 04:00:26.988755 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 63/149] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Jul 28 04:00:26 2022] POST /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0/os-volume_attachments => generated 194 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:27.011842 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a150f8fb-aa8b-4eac-8cfe-883773d130cf tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:27.017653 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-a150f8fb-aa8b-4eac-8cfe-883773d130cf tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:27.032134 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a150f8fb-aa8b-4eac-8cfe-883773d130cf tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:27.036367 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a150f8fb-aa8b-4eac-8cfe-883773d130cf tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:27.037549 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a150f8fb-aa8b-4eac-8cfe-883773d130cf tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:27.038398 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a150f8fb-aa8b-4eac-8cfe-883773d130cf tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:27.061070 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-2d79c85a-0d45-4d36-94cc-5db9b1307e3f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:27.077062 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-2d79c85a-0d45-4d36-94cc-5db9b1307e3f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1367 microversion: 2.1 time: 0.329191 Jul 28 04:00:27.082685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 87/150] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:26 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1367 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:27.096744 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fa271271-cdf9-4a29-9a43-7b13cbd0b799 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:27.098517 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-fa271271-cdf9-4a29-9a43-7b13cbd0b799 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:27.114231 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fa271271-cdf9-4a29-9a43-7b13cbd0b799 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:27.115316 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fa271271-cdf9-4a29-9a43-7b13cbd0b799 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:27.121446 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fa271271-cdf9-4a29-9a43-7b13cbd0b799 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:27.122280 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fa271271-cdf9-4a29-9a43-7b13cbd0b799 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:27.386850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-fa271271-cdf9-4a29-9a43-7b13cbd0b799 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:27.400593 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-fa271271-cdf9-4a29-9a43-7b13cbd0b799 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1361 microversion: 2.1 time: 0.312965 Jul 28 04:00:27.403136 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 88/151] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:27 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1361 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:27.425184 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-a150f8fb-aa8b-4eac-8cfe-883773d130cf tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:27.441434 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-a150f8fb-aa8b-4eac-8cfe-883773d130cf tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1515 microversion: 2.1 time: 0.436764 Jul 28 04:00:27.442043 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 64/152] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:26 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1515 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:27.464215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3966d5e6-63ee-462e-a7ab-b56fbbfcc2ec tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:27.467500 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3966d5e6-63ee-462e-a7ab-b56fbbfcc2ec tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:27.475564 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3966d5e6-63ee-462e-a7ab-b56fbbfcc2ec tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:27.476946 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3966d5e6-63ee-462e-a7ab-b56fbbfcc2ec tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:27.478016 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3966d5e6-63ee-462e-a7ab-b56fbbfcc2ec tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:27.478598 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3966d5e6-63ee-462e-a7ab-b56fbbfcc2ec tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:27.565288 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.objects.instance [None req-3966d5e6-63ee-462e-a7ab-b56fbbfcc2ec tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lazy-loading 'flavor' on Instance uuid b9e96863-0e05-4ac4-ba31-95db87337440 {{(pid=118187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:00:27.704043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3966d5e6-63ee-462e-a7ab-b56fbbfcc2ec tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "POST /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440/action" status: 200 len: 32 microversion: 2.1 time: 0.243595 Jul 28 04:00:27.705312 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 89/153] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Jul 28 04:00:27 2022] POST /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440/action => generated 32 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:00:27.715097 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-dd25bea7-9b7f-4f46-b5d9-b6c8cb21ceee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:27.716024 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-dd25bea7-9b7f-4f46-b5d9-b6c8cb21ceee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:27.724682 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dd25bea7-9b7f-4f46-b5d9-b6c8cb21ceee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:27.725431 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dd25bea7-9b7f-4f46-b5d9-b6c8cb21ceee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:27.726604 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dd25bea7-9b7f-4f46-b5d9-b6c8cb21ceee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:27.727075 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dd25bea7-9b7f-4f46-b5d9-b6c8cb21ceee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:27.884159 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-dd25bea7-9b7f-4f46-b5d9-b6c8cb21ceee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:27.893929 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-dd25bea7-9b7f-4f46-b5d9-b6c8cb21ceee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.183108 Jul 28 04:00:27.894518 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 65/154] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:27 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:27.980361 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-8dbbd398-19d9-42a1-84dd-60728108c9e3 req-7be21f01-4f9e-4e0a-8499-14e45cf7060c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9103b14-a0f8-40f5-b38b-54b90cae2131", "name": "network-vif-plugged", "status": "completed", "tag": "cf1dd0bc-9549-4cae-9755-ef7ec478ee92"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:27.993560 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-8dbbd398-19d9-42a1-84dd-60728108c9e3 req-7be21f01-4f9e-4e0a-8499-14e45cf7060c service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:27.994099 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-8dbbd398-19d9-42a1-84dd-60728108c9e3 req-7be21f01-4f9e-4e0a-8499-14e45cf7060c service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:28.013273 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-8dbbd398-19d9-42a1-84dd-60728108c9e3 req-7be21f01-4f9e-4e0a-8499-14e45cf7060c service nova] Creating event network-vif-plugged:cf1dd0bc-9549-4cae-9755-ef7ec478ee92 for instance f9103b14-a0f8-40f5-b38b-54b90cae2131 on hv-cinder-79987 Jul 28 04:00:28.028720 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-8dbbd398-19d9-42a1-84dd-60728108c9e3 req-7be21f01-4f9e-4e0a-8499-14e45cf7060c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052484 Jul 28 04:00:28.032221 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 90/155] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:00:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:28.104059 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-f0199023-f8e4-45db-a364-ff2eec5a8df3 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:28.104688 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-f0199023-f8e4-45db-a364-ff2eec5a8df3 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:28.116711 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f0199023-f8e4-45db-a364-ff2eec5a8df3 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:28.117175 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f0199023-f8e4-45db-a364-ff2eec5a8df3 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:28.123121 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f0199023-f8e4-45db-a364-ff2eec5a8df3 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:28.123615 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f0199023-f8e4-45db-a364-ff2eec5a8df3 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:28.343084 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-f0199023-f8e4-45db-a364-ff2eec5a8df3 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:28.353097 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-f0199023-f8e4-45db-a364-ff2eec5a8df3 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1367 microversion: 2.1 time: 0.254225 Jul 28 04:00:28.354332 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 66/156] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:28 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1367 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:28.424498 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-1d14bb04-4807-4661-9aaf-7542e13ee68f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:28.425244 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-1d14bb04-4807-4661-9aaf-7542e13ee68f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:28.435712 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1d14bb04-4807-4661-9aaf-7542e13ee68f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:28.440394 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1d14bb04-4807-4661-9aaf-7542e13ee68f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:28.446619 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1d14bb04-4807-4661-9aaf-7542e13ee68f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:28.449127 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1d14bb04-4807-4661-9aaf-7542e13ee68f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:28.673361 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1d14bb04-4807-4661-9aaf-7542e13ee68f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:28.682595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-1d14bb04-4807-4661-9aaf-7542e13ee68f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1361 microversion: 2.1 time: 0.262958 Jul 28 04:00:28.695313 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 91/157] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:28 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1361 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:28.915685 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-b307fd67-6a4a-4f4b-ab93-d0600efee749 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:28.916287 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-b307fd67-6a4a-4f4b-ab93-d0600efee749 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:28.935149 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b307fd67-6a4a-4f4b-ab93-d0600efee749 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:28.935604 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b307fd67-6a4a-4f4b-ab93-d0600efee749 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:28.936401 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b307fd67-6a4a-4f4b-ab93-d0600efee749 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:28.936986 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b307fd67-6a4a-4f4b-ab93-d0600efee749 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:29.276209 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-b307fd67-6a4a-4f4b-ab93-d0600efee749 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:29.279977 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:29.289987 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-b307fd67-6a4a-4f4b-ab93-d0600efee749 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.378389 Jul 28 04:00:29.303211 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 67/158] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:28 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:29.376295 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-324e4ee0-90b3-41f6-9f82-22be50f6d278 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:29.377693 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-324e4ee0-90b3-41f6-9f82-22be50f6d278 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:29.382838 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=100 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:29.385891 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-324e4ee0-90b3-41f6-9f82-22be50f6d278 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:29.386424 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-324e4ee0-90b3-41f6-9f82-22be50f6d278 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:29.387425 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-324e4ee0-90b3-41f6-9f82-22be50f6d278 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:29.387858 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-324e4ee0-90b3-41f6-9f82-22be50f6d278 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:29.561104 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-324e4ee0-90b3-41f6-9f82-22be50f6d278 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:29.570802 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-324e4ee0-90b3-41f6-9f82-22be50f6d278 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1367 microversion: 2.1 time: 0.199074 Jul 28 04:00:29.571487 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 92/159] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:29 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1367 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:29.703876 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-0992361a-fe8c-46b2-9fbf-56edb551f57a tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:29.704489 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-0992361a-fe8c-46b2-9fbf-56edb551f57a tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:29.710925 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0992361a-fe8c-46b2-9fbf-56edb551f57a tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:29.711540 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0992361a-fe8c-46b2-9fbf-56edb551f57a tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:29.712295 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0992361a-fe8c-46b2-9fbf-56edb551f57a tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:29.712898 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0992361a-fe8c-46b2-9fbf-56edb551f57a tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:29.865876 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-0992361a-fe8c-46b2-9fbf-56edb551f57a tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:29.873570 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-0992361a-fe8c-46b2-9fbf-56edb551f57a tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1547 microversion: 2.1 time: 0.174177 Jul 28 04:00:29.895460 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c1562371-0e59-49b3-9a54-3eccb66af08d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:29.895955 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c1562371-0e59-49b3-9a54-3eccb66af08d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:29.900422 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 68/160] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:29 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1547 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:29.902055 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c1562371-0e59-49b3-9a54-3eccb66af08d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:29.902509 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c1562371-0e59-49b3-9a54-3eccb66af08d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:29.903669 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c1562371-0e59-49b3-9a54-3eccb66af08d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:29.904191 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c1562371-0e59-49b3-9a54-3eccb66af08d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:29.998468 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c1562371-0e59-49b3-9a54-3eccb66af08d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106708 Jul 28 04:00:30.008435 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 93/161] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Jul 28 04:00:29 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475/os-interface => generated 285 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:30.313333 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-bda3677a-f086-4c43-826e-d916e2177987 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:30.314455 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-bda3677a-f086-4c43-826e-d916e2177987 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:30.323329 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bda3677a-f086-4c43-826e-d916e2177987 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:30.324010 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bda3677a-f086-4c43-826e-d916e2177987 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:30.324995 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bda3677a-f086-4c43-826e-d916e2177987 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:30.326593 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bda3677a-f086-4c43-826e-d916e2177987 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:30.592727 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3dac5211-627c-4113-9c94-4d545ffbcb77 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:30.594033 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3dac5211-627c-4113-9c94-4d545ffbcb77 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:30.602734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3dac5211-627c-4113-9c94-4d545ffbcb77 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:30.603276 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3dac5211-627c-4113-9c94-4d545ffbcb77 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:30.604267 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3dac5211-627c-4113-9c94-4d545ffbcb77 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:30.604885 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3dac5211-627c-4113-9c94-4d545ffbcb77 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:30.812619 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3dac5211-627c-4113-9c94-4d545ffbcb77 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:30.824077 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3dac5211-627c-4113-9c94-4d545ffbcb77 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1367 microversion: 2.1 time: 0.235043 Jul 28 04:00:30.827193 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 94/162] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:30 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1367 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:30.973549 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-bda3677a-f086-4c43-826e-d916e2177987 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:30.981561 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-bda3677a-f086-4c43-826e-d916e2177987 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.674141 Jul 28 04:00:30.993184 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 69/163] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:30 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:31.850734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-30a13953-5ed0-4247-89ea-edc4d695223b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:31.852245 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-30a13953-5ed0-4247-89ea-edc4d695223b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:31.872988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-30a13953-5ed0-4247-89ea-edc4d695223b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:31.873452 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-30a13953-5ed0-4247-89ea-edc4d695223b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:31.884360 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-30a13953-5ed0-4247-89ea-edc4d695223b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:31.885028 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-30a13953-5ed0-4247-89ea-edc4d695223b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:31.898399 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-7eecb3e1-74b7-476d-a36e-4ff750dd8e13 req-a4943b33-6e51-4c5f-baac-fd7488ef28c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "beb705c5-be1c-471d-82d9-b6d699ead475", "tag": "bcfe84f6-7f7b-4876-8b26-9916056e7600"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:31.916562 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-7eecb3e1-74b7-476d-a36e-4ff750dd8e13 req-a4943b33-6e51-4c5f-baac-fd7488ef28c9 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:31.917814 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-7eecb3e1-74b7-476d-a36e-4ff750dd8e13 req-a4943b33-6e51-4c5f-baac-fd7488ef28c9 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:31.955495 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-7eecb3e1-74b7-476d-a36e-4ff750dd8e13 req-a4943b33-6e51-4c5f-baac-fd7488ef28c9 service nova] Creating event network-changed:bcfe84f6-7f7b-4876-8b26-9916056e7600 for instance beb705c5-be1c-471d-82d9-b6d699ead475 on hv-cinder-79987 Jul 28 04:00:31.971525 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-7eecb3e1-74b7-476d-a36e-4ff750dd8e13 req-a4943b33-6e51-4c5f-baac-fd7488ef28c9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077763 Jul 28 04:00:31.972860 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 70/164] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:00:32.018258 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-75af741f-d7d8-4821-bf99-44e6b39303fa tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:32.019941 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-75af741f-d7d8-4821-bf99-44e6b39303fa tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:32.044343 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-75af741f-d7d8-4821-bf99-44e6b39303fa tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:32.048259 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-75af741f-d7d8-4821-bf99-44e6b39303fa tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:32.053160 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-75af741f-d7d8-4821-bf99-44e6b39303fa tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:32.060320 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-75af741f-d7d8-4821-bf99-44e6b39303fa tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:32.138685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-30a13953-5ed0-4247-89ea-edc4d695223b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:32.148125 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-30a13953-5ed0-4247-89ea-edc4d695223b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1556 microversion: 2.1 time: 0.303010 Jul 28 04:00:32.149203 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 95/165] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:31 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1556 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:32.172350 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b3d806eb-c0a5-4138-8df9-0ef9c6011639 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:32.173043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b3d806eb-c0a5-4138-8df9-0ef9c6011639 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:32.184494 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b3d806eb-c0a5-4138-8df9-0ef9c6011639 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:32.185393 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b3d806eb-c0a5-4138-8df9-0ef9c6011639 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:32.186332 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b3d806eb-c0a5-4138-8df9-0ef9c6011639 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:32.188834 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b3d806eb-c0a5-4138-8df9-0ef9c6011639 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:32.403266 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b3d806eb-c0a5-4138-8df9-0ef9c6011639 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.236752 Jul 28 04:00:32.404100 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 96/166] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Jul 28 04:00:32 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131/os-interface => generated 284 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:00:32.579444 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-75af741f-d7d8-4821-bf99-44e6b39303fa tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:32.596003 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-75af741f-d7d8-4821-bf99-44e6b39303fa tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.576179 Jul 28 04:00:32.596801 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 71/167] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:32 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:33.621512 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-09e5046e-fffe-4e1e-8795-99473639ccee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:33.622677 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-09e5046e-fffe-4e1e-8795-99473639ccee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:33.633953 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-09e5046e-fffe-4e1e-8795-99473639ccee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:33.636464 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-09e5046e-fffe-4e1e-8795-99473639ccee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:33.637696 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-09e5046e-fffe-4e1e-8795-99473639ccee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:33.638336 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-09e5046e-fffe-4e1e-8795-99473639ccee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:33.690051 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:34.001811 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-09e5046e-fffe-4e1e-8795-99473639ccee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:34.021681 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-09e5046e-fffe-4e1e-8795-99473639ccee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.403993 Jul 28 04:00:34.023526 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 97/168] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:33 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:34.206203 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-86fefd72-d6f3-4ea2-88a5-8d3c188c7329 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1551207226", "imageRef": "a0eec51c-83e9-420b-bcb9-20fe8dcf5321", "flavorRef": "452", "networks": [{"uuid": "00066c96-9353-459f-8282-fe1e0505aebc"}]}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:34.260301 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.network.neutron [None req-86fefd72-d6f3-4ea2-88a5-8d3c188c7329 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] validate_networks() for [('00066c96-9353-459f-8282-fe1e0505aebc', None, None, None, None, None)] {{(pid=118186) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:00:34.568247 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-d732d244-cc8c-40ff-b895-f0002e580160 req-50a9f7d8-f767-4fe3-b873-55962578be69 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f9103b14-a0f8-40f5-b38b-54b90cae2131", "tag": "cf1dd0bc-9549-4cae-9755-ef7ec478ee92"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:34.590735 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-d732d244-cc8c-40ff-b895-f0002e580160 req-50a9f7d8-f767-4fe3-b873-55962578be69 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:34.591439 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-d732d244-cc8c-40ff-b895-f0002e580160 req-50a9f7d8-f767-4fe3-b873-55962578be69 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:34.614260 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-d732d244-cc8c-40ff-b895-f0002e580160 req-50a9f7d8-f767-4fe3-b873-55962578be69 service nova] Creating event network-changed:cf1dd0bc-9549-4cae-9755-ef7ec478ee92 for instance f9103b14-a0f8-40f5-b38b-54b90cae2131 on hv-cinder-79987 Jul 28 04:00:34.628661 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-d732d244-cc8c-40ff-b895-f0002e580160 req-50a9f7d8-f767-4fe3-b873-55962578be69 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063974 Jul 28 04:00:34.629338 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 98/169] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:34.705914 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-86fefd72-d6f3-4ea2-88a5-8d3c188c7329 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Flavor limits 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:00:34.706935 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-86fefd72-d6f3-4ea2-88a5-8d3c188c7329 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Image limits 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:00:34.707610 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-86fefd72-d6f3-4ea2-88a5-8d3c188c7329 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Flavor pref 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:00:34.708178 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-86fefd72-d6f3-4ea2-88a5-8d3c188c7329 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Image pref 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:00:34.708741 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-86fefd72-d6f3-4ea2-88a5-8d3c188c7329 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:00:34.723588 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-86fefd72-d6f3-4ea2-88a5-8d3c188c7329 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:34.726954 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-86fefd72-d6f3-4ea2-88a5-8d3c188c7329 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:34.729457 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-86fefd72-d6f3-4ea2-88a5-8d3c188c7329 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:34.731022 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-86fefd72-d6f3-4ea2-88a5-8d3c188c7329 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:34.783304 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-86fefd72-d6f3-4ea2-88a5-8d3c188c7329 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Getting quotas for project 9ed8ce4c8a3442deacf65acc0c05dad3. Resources: {'instances', 'cores', 'ram'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:00:34.788373 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-86fefd72-d6f3-4ea2-88a5-8d3c188c7329 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Getting quotas for user 820e385c27af49f08301be61fcde369b and project 9ed8ce4c8a3442deacf65acc0c05dad3. Resources: {'instances', 'cores', 'ram'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:00:34.809668 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-86fefd72-d6f3-4ea2-88a5-8d3c188c7329 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Going to run 1 instances... {{(pid=118186) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:00:34.812048 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-86fefd72-d6f3-4ea2-88a5-8d3c188c7329 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0eec51c-83e9-420b-bcb9-20fe8dcf5321',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:00:34.862351 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-86fefd72-d6f3-4ea2-88a5-8d3c188c7329 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.661755 Jul 28 04:00:34.874204 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5781f8a9-c83c-4a0b-a2a9-39820383a559 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:34.875685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5781f8a9-c83c-4a0b-a2a9-39820383a559 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:34.878685 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 72/170] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 04:00:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 669 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:00:34.939158 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5781f8a9-c83c-4a0b-a2a9-39820383a559 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:34.946187 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5781f8a9-c83c-4a0b-a2a9-39820383a559 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1214 microversion: 2.1 time: 0.076025 Jul 28 04:00:34.961792 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 99/171] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:34 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1214 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:35.045212 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-118dd103-3ba3-4843-b084-6834465aaa3f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:35.045843 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-118dd103-3ba3-4843-b084-6834465aaa3f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:35.053254 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-118dd103-3ba3-4843-b084-6834465aaa3f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:35.053672 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-118dd103-3ba3-4843-b084-6834465aaa3f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:35.054539 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-118dd103-3ba3-4843-b084-6834465aaa3f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:35.055013 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-118dd103-3ba3-4843-b084-6834465aaa3f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:35.265098 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-118dd103-3ba3-4843-b084-6834465aaa3f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:35.274228 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-118dd103-3ba3-4843-b084-6834465aaa3f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.232424 Jul 28 04:00:35.287895 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 73/172] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:35 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:35.969238 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-67f3eb76-57bf-4a75-a431-72b6c5a28488 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:35.970081 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-67f3eb76-57bf-4a75-a431-72b6c5a28488 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:35.976607 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-67f3eb76-57bf-4a75-a431-72b6c5a28488 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:35.977114 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-67f3eb76-57bf-4a75-a431-72b6c5a28488 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:35.977916 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-67f3eb76-57bf-4a75-a431-72b6c5a28488 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:35.978349 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-67f3eb76-57bf-4a75-a431-72b6c5a28488 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:36.044432 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-67f3eb76-57bf-4a75-a431-72b6c5a28488 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:36.052802 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-67f3eb76-57bf-4a75-a431-72b6c5a28488 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1218 microversion: 2.1 time: 0.087820 Jul 28 04:00:36.053369 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 100/173] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:35 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1218 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:36.298223 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c1f237d3-92a4-49ab-994b-6aa89588ddd1 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:36.298866 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c1f237d3-92a4-49ab-994b-6aa89588ddd1 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:36.305370 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c1f237d3-92a4-49ab-994b-6aa89588ddd1 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:36.306055 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c1f237d3-92a4-49ab-994b-6aa89588ddd1 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:36.306860 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c1f237d3-92a4-49ab-994b-6aa89588ddd1 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:36.307290 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c1f237d3-92a4-49ab-994b-6aa89588ddd1 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:36.751655 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-c1f237d3-92a4-49ab-994b-6aa89588ddd1 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:36.759286 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-c1f237d3-92a4-49ab-994b-6aa89588ddd1 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.465600 Jul 28 04:00:36.760521 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 74/174] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:36 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:37.078358 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-678193fd-e768-4561-93b6-86c6e79af376 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:37.079804 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-678193fd-e768-4561-93b6-86c6e79af376 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:37.086131 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-678193fd-e768-4561-93b6-86c6e79af376 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:37.086581 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-678193fd-e768-4561-93b6-86c6e79af376 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:37.087397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-678193fd-e768-4561-93b6-86c6e79af376 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:37.087836 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-678193fd-e768-4561-93b6-86c6e79af376 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:37.168677 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-678193fd-e768-4561-93b6-86c6e79af376 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:37.173850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-678193fd-e768-4561-93b6-86c6e79af376 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1218 microversion: 2.1 time: 0.103032 Jul 28 04:00:37.175839 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 101/175] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:37 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1218 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:37.781181 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-ee545742-76e9-4991-9a73-1f6c73d2858b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:37.781824 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-ee545742-76e9-4991-9a73-1f6c73d2858b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:37.784322 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:37.789775 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ee545742-76e9-4991-9a73-1f6c73d2858b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:37.790219 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ee545742-76e9-4991-9a73-1f6c73d2858b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:37.791141 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ee545742-76e9-4991-9a73-1f6c73d2858b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:37.791521 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ee545742-76e9-4991-9a73-1f6c73d2858b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:37.930523 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-ee545742-76e9-4991-9a73-1f6c73d2858b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:37.942606 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-ee545742-76e9-4991-9a73-1f6c73d2858b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.163311 Jul 28 04:00:37.944263 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 75/176] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:37 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:38.197841 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fbbcb64b-078f-461b-ae96-c98381eca3ec tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:38.198451 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-fbbcb64b-078f-461b-ae96-c98381eca3ec tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:38.208402 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fbbcb64b-078f-461b-ae96-c98381eca3ec tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:38.208935 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fbbcb64b-078f-461b-ae96-c98381eca3ec tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:38.209782 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fbbcb64b-078f-461b-ae96-c98381eca3ec tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:38.210472 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fbbcb64b-078f-461b-ae96-c98381eca3ec tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:38.309328 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-fbbcb64b-078f-461b-ae96-c98381eca3ec tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:38.319027 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-fbbcb64b-078f-461b-ae96-c98381eca3ec tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1218 microversion: 2.1 time: 0.125859 Jul 28 04:00:38.319994 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 102/177] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:38 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1218 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:38.784932 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-9baf7bb7-b058-4b44-a964-68ea12357f37 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-630134182", "imageRef": "a0eec51c-83e9-420b-bcb9-20fe8dcf5321", "flavorRef": "452", "networks": [{"uuid": "7ddbd13e-785d-4f40-a868-20c0f3f5c79e"}]}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:38.846659 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.network.neutron [None req-9baf7bb7-b058-4b44-a964-68ea12357f37 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] validate_networks() for [('7ddbd13e-785d-4f40-a868-20c0f3f5c79e', None, None, None, None, None)] {{(pid=118186) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:00:38.964730 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6ed37cc7-1087-46e2-9caa-12fdecf1d3fd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:38.965531 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6ed37cc7-1087-46e2-9caa-12fdecf1d3fd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:38.972965 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6ed37cc7-1087-46e2-9caa-12fdecf1d3fd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:38.973729 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6ed37cc7-1087-46e2-9caa-12fdecf1d3fd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:38.974567 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6ed37cc7-1087-46e2-9caa-12fdecf1d3fd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:38.975234 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6ed37cc7-1087-46e2-9caa-12fdecf1d3fd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:39.123468 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6ed37cc7-1087-46e2-9caa-12fdecf1d3fd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:39.131792 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6ed37cc7-1087-46e2-9caa-12fdecf1d3fd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.171662 Jul 28 04:00:39.132453 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 103/178] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:38 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:39.314648 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-9baf7bb7-b058-4b44-a964-68ea12357f37 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Flavor limits 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:00:39.315593 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-9baf7bb7-b058-4b44-a964-68ea12357f37 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Image limits 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:00:39.316015 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-9baf7bb7-b058-4b44-a964-68ea12357f37 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Flavor pref 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:00:39.316504 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-9baf7bb7-b058-4b44-a964-68ea12357f37 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Image pref 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:00:39.317013 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-9baf7bb7-b058-4b44-a964-68ea12357f37 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:00:39.328886 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9baf7bb7-b058-4b44-a964-68ea12357f37 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:39.329336 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9baf7bb7-b058-4b44-a964-68ea12357f37 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:39.330294 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9baf7bb7-b058-4b44-a964-68ea12357f37 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:39.330729 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9baf7bb7-b058-4b44-a964-68ea12357f37 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:39.341398 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ce1706f4-0a65-47d7-b819-677bbe58d75f tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:39.342002 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ce1706f4-0a65-47d7-b819-677bbe58d75f tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:39.349289 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-9baf7bb7-b058-4b44-a964-68ea12357f37 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Getting quotas for project 3e4289e377d24036b968d0ae71c61dcc. Resources: {'instances', 'cores', 'ram'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:00:39.350056 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ce1706f4-0a65-47d7-b819-677bbe58d75f tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:39.350495 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ce1706f4-0a65-47d7-b819-677bbe58d75f tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:39.351299 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ce1706f4-0a65-47d7-b819-677bbe58d75f tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:39.351725 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ce1706f4-0a65-47d7-b819-677bbe58d75f tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:39.353116 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-9baf7bb7-b058-4b44-a964-68ea12357f37 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Getting quotas for user 518ad5eb820e44aa9689215e6038a521 and project 3e4289e377d24036b968d0ae71c61dcc. Resources: {'instances', 'cores', 'ram'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:00:39.367005 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-9baf7bb7-b058-4b44-a964-68ea12357f37 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Going to run 1 instances... {{(pid=118186) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:00:39.369281 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-9baf7bb7-b058-4b44-a964-68ea12357f37 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0eec51c-83e9-420b-bcb9-20fe8dcf5321',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:00:39.420323 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-9baf7bb7-b058-4b44-a964-68ea12357f37 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.640359 Jul 28 04:00:39.420975 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 76/179] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 04:00:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:00:39.425783 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-01401607-e831-4aef-b837-965e2ec90bb2 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:39.426150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-01401607-e831-4aef-b837-965e2ec90bb2 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:39.429097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ce1706f4-0a65-47d7-b819-677bbe58d75f tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:39.439669 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-01401607-e831-4aef-b837-965e2ec90bb2 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:39.440185 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-01401607-e831-4aef-b837-965e2ec90bb2 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:39.441402 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-01401607-e831-4aef-b837-965e2ec90bb2 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:39.441882 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-01401607-e831-4aef-b837-965e2ec90bb2 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:39.464454 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ce1706f4-0a65-47d7-b819-677bbe58d75f tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1266 microversion: 2.1 time: 0.126326 Jul 28 04:00:39.465904 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 104/180] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:39 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1266 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:39.474215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b82302c8-60cd-4e4a-b0cb-5dbfb27f5acf tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:39.475088 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-01401607-e831-4aef-b837-965e2ec90bb2 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Going to try to terminate instance {{(pid=118186) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:00:39.488000 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b82302c8-60cd-4e4a-b0cb-5dbfb27f5acf tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:39.603811 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b82302c8-60cd-4e4a-b0cb-5dbfb27f5acf tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:39.611908 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-01401607-e831-4aef-b837-965e2ec90bb2 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 204 len: 0 microversion: 2.1 time: 0.189624 Jul 28 04:00:39.612413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b82302c8-60cd-4e4a-b0cb-5dbfb27f5acf tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1218 microversion: 2.1 time: 0.145205 Jul 28 04:00:39.613091 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 77/181] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:00:39 2022] DELETE /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:00:39.613357 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 105/182] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:39 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1218 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:39.623506 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-46020c67-a173-4e93-88fa-1d3f84850dee tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:39.625371 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-46020c67-a173-4e93-88fa-1d3f84850dee tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:39.632761 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-46020c67-a173-4e93-88fa-1d3f84850dee tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:39.633384 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-46020c67-a173-4e93-88fa-1d3f84850dee tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:39.634280 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-46020c67-a173-4e93-88fa-1d3f84850dee tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:39.634722 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-46020c67-a173-4e93-88fa-1d3f84850dee tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:39.790089 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-46020c67-a173-4e93-88fa-1d3f84850dee tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:39.801435 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-46020c67-a173-4e93-88fa-1d3f84850dee tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1554 microversion: 2.1 time: 0.183762 Jul 28 04:00:39.802032 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 78/183] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:39 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1554 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:40.152295 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fcadf93f-afb4-49c0-927f-b2e5e7df1964 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:40.152902 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-fcadf93f-afb4-49c0-927f-b2e5e7df1964 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:40.159892 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fcadf93f-afb4-49c0-927f-b2e5e7df1964 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:40.160334 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fcadf93f-afb4-49c0-927f-b2e5e7df1964 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:40.161081 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fcadf93f-afb4-49c0-927f-b2e5e7df1964 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:40.161507 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fcadf93f-afb4-49c0-927f-b2e5e7df1964 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:40.288683 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-fcadf93f-afb4-49c0-927f-b2e5e7df1964 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:40.296608 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-fcadf93f-afb4-49c0-927f-b2e5e7df1964 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.147839 Jul 28 04:00:40.297351 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 106/184] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:40 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:40.486151 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-18831eb9-2503-4cc3-b3dd-eca13c9193bc tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:40.486809 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-18831eb9-2503-4cc3-b3dd-eca13c9193bc tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:40.492863 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-18831eb9-2503-4cc3-b3dd-eca13c9193bc tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:40.493244 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-18831eb9-2503-4cc3-b3dd-eca13c9193bc tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:40.493992 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-18831eb9-2503-4cc3-b3dd-eca13c9193bc tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:40.494418 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-18831eb9-2503-4cc3-b3dd-eca13c9193bc tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:40.556703 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-18831eb9-2503-4cc3-b3dd-eca13c9193bc tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:40.565135 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-18831eb9-2503-4cc3-b3dd-eca13c9193bc tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1266 microversion: 2.1 time: 0.082952 Jul 28 04:00:40.565702 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 79/185] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:40 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:40.633535 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-930c4c4c-3c0d-446b-85e5-2f78deceb83f tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:40.634147 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-930c4c4c-3c0d-446b-85e5-2f78deceb83f tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:40.640252 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-930c4c4c-3c0d-446b-85e5-2f78deceb83f tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:40.640718 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-930c4c4c-3c0d-446b-85e5-2f78deceb83f tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:40.641463 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-930c4c4c-3c0d-446b-85e5-2f78deceb83f tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:40.641891 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-930c4c4c-3c0d-446b-85e5-2f78deceb83f tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:40.703284 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-930c4c4c-3c0d-446b-85e5-2f78deceb83f tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:40.710603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-930c4c4c-3c0d-446b-85e5-2f78deceb83f tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1222 microversion: 2.1 time: 0.080823 Jul 28 04:00:40.711201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 107/186] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:40 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:40.821421 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-fc486446-51ea-48a7-a50f-4901eac80a48 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:40.822030 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-fc486446-51ea-48a7-a50f-4901eac80a48 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:40.829306 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fc486446-51ea-48a7-a50f-4901eac80a48 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:40.829755 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fc486446-51ea-48a7-a50f-4901eac80a48 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:40.830526 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fc486446-51ea-48a7-a50f-4901eac80a48 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:40.831011 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fc486446-51ea-48a7-a50f-4901eac80a48 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:40.965242 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-fc486446-51ea-48a7-a50f-4901eac80a48 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:40.973869 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-fc486446-51ea-48a7-a50f-4901eac80a48 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1554 microversion: 2.1 time: 0.156406 Jul 28 04:00:40.974453 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 80/187] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:40 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:41.318411 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-cff6e148-64b8-44a9-9037-70203247759a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:41.319115 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-cff6e148-64b8-44a9-9037-70203247759a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:41.325147 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cff6e148-64b8-44a9-9037-70203247759a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:41.325590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cff6e148-64b8-44a9-9037-70203247759a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:41.326343 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cff6e148-64b8-44a9-9037-70203247759a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:41.326773 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cff6e148-64b8-44a9-9037-70203247759a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:41.451966 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-cff6e148-64b8-44a9-9037-70203247759a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:41.459925 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-cff6e148-64b8-44a9-9037-70203247759a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.145380 Jul 28 04:00:41.460485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 108/188] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:41 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:41.586204 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-49f6e6bf-08a9-4ccd-9794-21a9ea43f8f6 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:41.586777 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-49f6e6bf-08a9-4ccd-9794-21a9ea43f8f6 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:41.592777 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-49f6e6bf-08a9-4ccd-9794-21a9ea43f8f6 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:41.593850 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-49f6e6bf-08a9-4ccd-9794-21a9ea43f8f6 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:41.594614 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-49f6e6bf-08a9-4ccd-9794-21a9ea43f8f6 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:41.595077 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-49f6e6bf-08a9-4ccd-9794-21a9ea43f8f6 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:41.653349 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-49f6e6bf-08a9-4ccd-9794-21a9ea43f8f6 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:41.661342 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-49f6e6bf-08a9-4ccd-9794-21a9ea43f8f6 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1266 microversion: 2.1 time: 0.078967 Jul 28 04:00:41.661946 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 81/189] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:41 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1266 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:41.730216 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-50dfcf11-9603-492c-b617-1c91d3c3da83 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:41.730857 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-50dfcf11-9603-492c-b617-1c91d3c3da83 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:41.737199 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-50dfcf11-9603-492c-b617-1c91d3c3da83 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:41.737645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-50dfcf11-9603-492c-b617-1c91d3c3da83 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:41.738393 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-50dfcf11-9603-492c-b617-1c91d3c3da83 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:41.738851 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-50dfcf11-9603-492c-b617-1c91d3c3da83 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:41.798017 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-50dfcf11-9603-492c-b617-1c91d3c3da83 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:41.805386 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-50dfcf11-9603-492c-b617-1c91d3c3da83 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1222 microversion: 2.1 time: 0.078989 Jul 28 04:00:41.805953 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 109/190] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:41 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1222 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:41.994643 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-91a57281-29e8-49a4-974b-fcdb0a9725c8 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:41.995294 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-91a57281-29e8-49a4-974b-fcdb0a9725c8 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:42.002391 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-91a57281-29e8-49a4-974b-fcdb0a9725c8 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:42.002873 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-91a57281-29e8-49a4-974b-fcdb0a9725c8 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:42.003640 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-91a57281-29e8-49a4-974b-fcdb0a9725c8 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:42.004078 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-91a57281-29e8-49a4-974b-fcdb0a9725c8 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:42.137144 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-91a57281-29e8-49a4-974b-fcdb0a9725c8 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:42.145543 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-91a57281-29e8-49a4-974b-fcdb0a9725c8 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1554 microversion: 2.1 time: 0.154717 Jul 28 04:00:42.146048 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 82/191] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:41 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1554 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:42.481946 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3b99ee3d-b709-42b5-93ff-4c8e57ce62c5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:42.482515 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3b99ee3d-b709-42b5-93ff-4c8e57ce62c5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:42.489203 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3b99ee3d-b709-42b5-93ff-4c8e57ce62c5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:42.489654 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3b99ee3d-b709-42b5-93ff-4c8e57ce62c5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:42.490414 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3b99ee3d-b709-42b5-93ff-4c8e57ce62c5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:42.490885 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3b99ee3d-b709-42b5-93ff-4c8e57ce62c5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:42.625890 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3b99ee3d-b709-42b5-93ff-4c8e57ce62c5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:42.634160 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3b99ee3d-b709-42b5-93ff-4c8e57ce62c5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.156063 Jul 28 04:00:42.634729 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 110/192] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:42 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:42.685539 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-eb15eaf8-ea0e-40b7-b32a-ae4de4b285e7 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:42.686524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-eb15eaf8-ea0e-40b7-b32a-ae4de4b285e7 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:42.695496 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-eb15eaf8-ea0e-40b7-b32a-ae4de4b285e7 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:42.696029 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-eb15eaf8-ea0e-40b7-b32a-ae4de4b285e7 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:42.696820 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-eb15eaf8-ea0e-40b7-b32a-ae4de4b285e7 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:42.697382 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-eb15eaf8-ea0e-40b7-b32a-ae4de4b285e7 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:42.775718 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-eb15eaf8-ea0e-40b7-b32a-ae4de4b285e7 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:42.784129 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-eb15eaf8-ea0e-40b7-b32a-ae4de4b285e7 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1266 microversion: 2.1 time: 0.105513 Jul 28 04:00:42.784698 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 83/193] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:42 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1266 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:42.826296 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-0383fa6c-764b-4c54-bd56-548366155081 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:42.826943 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-0383fa6c-764b-4c54-bd56-548366155081 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:42.832998 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0383fa6c-764b-4c54-bd56-548366155081 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:42.833443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0383fa6c-764b-4c54-bd56-548366155081 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:42.834186 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0383fa6c-764b-4c54-bd56-548366155081 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:42.834620 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0383fa6c-764b-4c54-bd56-548366155081 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:42.894942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-0383fa6c-764b-4c54-bd56-548366155081 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:42.902449 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-0383fa6c-764b-4c54-bd56-548366155081 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1222 microversion: 2.1 time: 0.079856 Jul 28 04:00:42.903040 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 111/194] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:42 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:43.167245 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-bfb45090-01da-44f5-a329-cbe7b5ab0da7 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:43.167861 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-bfb45090-01da-44f5-a329-cbe7b5ab0da7 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:43.174602 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bfb45090-01da-44f5-a329-cbe7b5ab0da7 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:43.175088 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bfb45090-01da-44f5-a329-cbe7b5ab0da7 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:43.175840 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bfb45090-01da-44f5-a329-cbe7b5ab0da7 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:43.176268 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bfb45090-01da-44f5-a329-cbe7b5ab0da7 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:43.308217 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-bfb45090-01da-44f5-a329-cbe7b5ab0da7 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:43.312220 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:43.319567 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-bfb45090-01da-44f5-a329-cbe7b5ab0da7 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1554 microversion: 2.1 time: 0.156335 Jul 28 04:00:43.320159 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 84/195] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:43 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:43.656897 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e6eb95a8-6883-4a82-9813-29cbad4d6145 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:43.657434 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e6eb95a8-6883-4a82-9813-29cbad4d6145 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:43.663713 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e6eb95a8-6883-4a82-9813-29cbad4d6145 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:43.664165 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e6eb95a8-6883-4a82-9813-29cbad4d6145 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:43.664933 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e6eb95a8-6883-4a82-9813-29cbad4d6145 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:43.665363 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e6eb95a8-6883-4a82-9813-29cbad4d6145 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:43.797302 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e6eb95a8-6883-4a82-9813-29cbad4d6145 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:43.806974 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e6eb95a8-6883-4a82-9813-29cbad4d6145 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.154389 Jul 28 04:00:43.807703 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 112/196] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:43 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:43.809164 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-856fdf69-8707-4985-9abe-ebe29bcfe6ef tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:43.809919 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-856fdf69-8707-4985-9abe-ebe29bcfe6ef tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:43.818503 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-856fdf69-8707-4985-9abe-ebe29bcfe6ef tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:43.818998 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-856fdf69-8707-4985-9abe-ebe29bcfe6ef tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:43.819760 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-856fdf69-8707-4985-9abe-ebe29bcfe6ef tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:43.820186 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-856fdf69-8707-4985-9abe-ebe29bcfe6ef tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:43.892091 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-856fdf69-8707-4985-9abe-ebe29bcfe6ef tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:43.900066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-856fdf69-8707-4985-9abe-ebe29bcfe6ef tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1274 microversion: 2.1 time: 0.097060 Jul 28 04:00:43.902923 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 85/197] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:43 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1274 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:43.923972 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-40badd38-5317-4c69-bfdc-55411b9f6671 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:43.924597 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-40badd38-5317-4c69-bfdc-55411b9f6671 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:43.930643 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-40badd38-5317-4c69-bfdc-55411b9f6671 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:43.931160 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-40badd38-5317-4c69-bfdc-55411b9f6671 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:43.931925 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-40badd38-5317-4c69-bfdc-55411b9f6671 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:43.932364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-40badd38-5317-4c69-bfdc-55411b9f6671 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:43.997797 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-40badd38-5317-4c69-bfdc-55411b9f6671 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:44.006417 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-40badd38-5317-4c69-bfdc-55411b9f6671 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1222 microversion: 2.1 time: 0.086438 Jul 28 04:00:44.007214 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 113/198] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:43 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1222 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:44.341495 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-5117cd9e-2f05-4efb-9468-9f288399f16c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:44.342114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-5117cd9e-2f05-4efb-9468-9f288399f16c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:44.348930 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5117cd9e-2f05-4efb-9468-9f288399f16c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:44.349378 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5117cd9e-2f05-4efb-9468-9f288399f16c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:44.350136 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5117cd9e-2f05-4efb-9468-9f288399f16c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:44.350567 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5117cd9e-2f05-4efb-9468-9f288399f16c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:44.481927 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-5117cd9e-2f05-4efb-9468-9f288399f16c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:44.491752 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-5117cd9e-2f05-4efb-9468-9f288399f16c tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1554 microversion: 2.1 time: 0.154078 Jul 28 04:00:44.492330 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 86/199] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:44 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1554 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:44.830387 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ea092298-8c6a-43d1-a59b-8105a045efa5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:44.831051 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ea092298-8c6a-43d1-a59b-8105a045efa5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:44.837074 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ea092298-8c6a-43d1-a59b-8105a045efa5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:44.837516 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ea092298-8c6a-43d1-a59b-8105a045efa5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:44.838266 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ea092298-8c6a-43d1-a59b-8105a045efa5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:44.838697 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ea092298-8c6a-43d1-a59b-8105a045efa5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:44.921255 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-15386cc3-5353-4506-b6a1-a9f56a584d68 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:44.921861 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-15386cc3-5353-4506-b6a1-a9f56a584d68 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:44.928030 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-15386cc3-5353-4506-b6a1-a9f56a584d68 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:44.928474 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-15386cc3-5353-4506-b6a1-a9f56a584d68 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:44.929230 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-15386cc3-5353-4506-b6a1-a9f56a584d68 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:44.929659 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-15386cc3-5353-4506-b6a1-a9f56a584d68 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:44.968772 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ea092298-8c6a-43d1-a59b-8105a045efa5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:44.977080 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ea092298-8c6a-43d1-a59b-8105a045efa5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.151596 Jul 28 04:00:44.977839 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 114/200] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:44 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:44.993159 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-15386cc3-5353-4506-b6a1-a9f56a584d68 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:45.001462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-15386cc3-5353-4506-b6a1-a9f56a584d68 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1274 microversion: 2.1 time: 0.083984 Jul 28 04:00:45.002031 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 87/201] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:44 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:45.029847 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-85bed342-ac88-4d5d-af96-55f5300ba65d tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:45.031097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-85bed342-ac88-4d5d-af96-55f5300ba65d tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:45.037179 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-85bed342-ac88-4d5d-af96-55f5300ba65d tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:45.037629 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-85bed342-ac88-4d5d-af96-55f5300ba65d tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:45.038645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-85bed342-ac88-4d5d-af96-55f5300ba65d tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:45.039111 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-85bed342-ac88-4d5d-af96-55f5300ba65d tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:45.098234 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-85bed342-ac88-4d5d-af96-55f5300ba65d tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:45.105745 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-85bed342-ac88-4d5d-af96-55f5300ba65d tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1222 microversion: 2.1 time: 0.080050 Jul 28 04:00:45.106305 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 115/202] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:45 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1222 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:45.513067 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-b5f08143-84dc-4f3c-846a-daf9c75cd235 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:45.513678 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-b5f08143-84dc-4f3c-846a-daf9c75cd235 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:45.521455 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b5f08143-84dc-4f3c-846a-daf9c75cd235 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:45.521455 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b5f08143-84dc-4f3c-846a-daf9c75cd235 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:45.522354 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b5f08143-84dc-4f3c-846a-daf9c75cd235 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:45.522955 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b5f08143-84dc-4f3c-846a-daf9c75cd235 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:45.653221 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-b5f08143-84dc-4f3c-846a-daf9c75cd235 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:45.661416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-b5f08143-84dc-4f3c-846a-daf9c75cd235 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1554 microversion: 2.1 time: 0.152273 Jul 28 04:00:45.661988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 88/203] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:45 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1554 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:45.998647 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3f94ba44-6a24-453c-8384-0d11143032c7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:45.999998 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3f94ba44-6a24-453c-8384-0d11143032c7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:46.005964 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3f94ba44-6a24-453c-8384-0d11143032c7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:46.006413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3f94ba44-6a24-453c-8384-0d11143032c7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:46.007185 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3f94ba44-6a24-453c-8384-0d11143032c7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:46.007614 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3f94ba44-6a24-453c-8384-0d11143032c7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:46.021373 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-80ee9dd2-768c-47bd-a78b-f84357c44b8c tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:46.021996 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-80ee9dd2-768c-47bd-a78b-f84357c44b8c tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:46.027995 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-80ee9dd2-768c-47bd-a78b-f84357c44b8c tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:46.028448 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-80ee9dd2-768c-47bd-a78b-f84357c44b8c tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:46.029212 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-80ee9dd2-768c-47bd-a78b-f84357c44b8c tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:46.029651 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-80ee9dd2-768c-47bd-a78b-f84357c44b8c tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:46.091925 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-80ee9dd2-768c-47bd-a78b-f84357c44b8c tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:46.101074 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-80ee9dd2-768c-47bd-a78b-f84357c44b8c tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1274 microversion: 2.1 time: 0.083086 Jul 28 04:00:46.101532 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 89/204] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:46 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1274 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:46.127785 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-4454c687-91e4-497e-a7ea-a05820ec8e38 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:46.128402 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-4454c687-91e4-497e-a7ea-a05820ec8e38 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:46.134332 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4454c687-91e4-497e-a7ea-a05820ec8e38 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:46.134822 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4454c687-91e4-497e-a7ea-a05820ec8e38 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:46.135574 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4454c687-91e4-497e-a7ea-a05820ec8e38 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:46.136011 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4454c687-91e4-497e-a7ea-a05820ec8e38 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:46.145613 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3f94ba44-6a24-453c-8384-0d11143032c7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:46.149332 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=100 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:46.154232 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3f94ba44-6a24-453c-8384-0d11143032c7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.159384 Jul 28 04:00:46.154907 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 116/205] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:45 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:46.196377 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-4454c687-91e4-497e-a7ea-a05820ec8e38 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:46.204044 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-4454c687-91e4-497e-a7ea-a05820ec8e38 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1222 microversion: 2.1 time: 0.080919 Jul 28 04:00:46.204610 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 90/206] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:46 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:46.682545 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a2e090c0-d99a-4f1b-a06a-b1638ec8e164 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:46.683174 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a2e090c0-d99a-4f1b-a06a-b1638ec8e164 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:46.689252 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a2e090c0-d99a-4f1b-a06a-b1638ec8e164 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:46.689696 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a2e090c0-d99a-4f1b-a06a-b1638ec8e164 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:46.690438 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a2e090c0-d99a-4f1b-a06a-b1638ec8e164 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:46.690889 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a2e090c0-d99a-4f1b-a06a-b1638ec8e164 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:46.818573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a2e090c0-d99a-4f1b-a06a-b1638ec8e164 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:46.826752 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a2e090c0-d99a-4f1b-a06a-b1638ec8e164 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1554 microversion: 2.1 time: 0.148147 Jul 28 04:00:46.827927 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 117/207] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:46 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:47.121927 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-765d7535-0359-4c85-81dc-ed52139204e5 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:47.122629 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-765d7535-0359-4c85-81dc-ed52139204e5 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:47.130188 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-765d7535-0359-4c85-81dc-ed52139204e5 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:47.130638 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-765d7535-0359-4c85-81dc-ed52139204e5 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:47.131447 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-765d7535-0359-4c85-81dc-ed52139204e5 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:47.131893 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-765d7535-0359-4c85-81dc-ed52139204e5 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:47.175306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-85d887e3-77e2-4e80-8762-639637dc85dc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:47.175921 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-85d887e3-77e2-4e80-8762-639637dc85dc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:47.182045 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-85d887e3-77e2-4e80-8762-639637dc85dc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:47.182494 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-85d887e3-77e2-4e80-8762-639637dc85dc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:47.183274 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-85d887e3-77e2-4e80-8762-639637dc85dc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:47.183711 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-85d887e3-77e2-4e80-8762-639637dc85dc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:47.194295 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-765d7535-0359-4c85-81dc-ed52139204e5 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:47.201659 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-765d7535-0359-4c85-81dc-ed52139204e5 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1274 microversion: 2.1 time: 0.083711 Jul 28 04:00:47.203194 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 91/208] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:47 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:47.224157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-9afaf451-adca-4c8c-9496-2463dc2786b4 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:47.224771 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-9afaf451-adca-4c8c-9496-2463dc2786b4 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:47.230703 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9afaf451-adca-4c8c-9496-2463dc2786b4 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:47.231256 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9afaf451-adca-4c8c-9496-2463dc2786b4 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:47.232019 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9afaf451-adca-4c8c-9496-2463dc2786b4 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:47.232452 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9afaf451-adca-4c8c-9496-2463dc2786b4 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:47.294747 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-9afaf451-adca-4c8c-9496-2463dc2786b4 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:47.302200 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-9afaf451-adca-4c8c-9496-2463dc2786b4 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1222 microversion: 2.1 time: 0.081704 Jul 28 04:00:47.302774 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 92/209] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:47 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1222 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:47.316941 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-85d887e3-77e2-4e80-8762-639637dc85dc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:47.324494 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-85d887e3-77e2-4e80-8762-639637dc85dc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.153035 Jul 28 04:00:47.325061 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 118/210] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:47 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:47.849245 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-f2af0031-f085-4990-8c56-421b4f2c75b5 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:47.849920 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-f2af0031-f085-4990-8c56-421b4f2c75b5 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:47.855982 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f2af0031-f085-4990-8c56-421b4f2c75b5 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:47.856430 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f2af0031-f085-4990-8c56-421b4f2c75b5 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:47.857193 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f2af0031-f085-4990-8c56-421b4f2c75b5 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:47.857628 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f2af0031-f085-4990-8c56-421b4f2c75b5 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:48.034654 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-f2af0031-f085-4990-8c56-421b4f2c75b5 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:48.044352 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-f2af0031-f085-4990-8c56-421b4f2c75b5 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1554 microversion: 2.1 time: 0.199109 Jul 28 04:00:48.044930 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 93/211] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:47 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1554 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:48.224170 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-60b0b172-7f2e-432c-bc5d-a0f892ea9775 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:48.225166 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-60b0b172-7f2e-432c-bc5d-a0f892ea9775 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:48.232639 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-60b0b172-7f2e-432c-bc5d-a0f892ea9775 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:48.233147 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-60b0b172-7f2e-432c-bc5d-a0f892ea9775 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:48.234206 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-60b0b172-7f2e-432c-bc5d-a0f892ea9775 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:48.234673 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-60b0b172-7f2e-432c-bc5d-a0f892ea9775 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:48.323760 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-2661648c-4f3c-416c-9327-d185db194831 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:48.324382 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-2661648c-4f3c-416c-9327-d185db194831 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:48.332459 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2661648c-4f3c-416c-9327-d185db194831 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:48.333185 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2661648c-4f3c-416c-9327-d185db194831 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:48.333964 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2661648c-4f3c-416c-9327-d185db194831 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:48.334428 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2661648c-4f3c-416c-9327-d185db194831 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:48.398931 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-60b0b172-7f2e-432c-bc5d-a0f892ea9775 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:48.405313 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-2661648c-4f3c-416c-9327-d185db194831 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:48.411913 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-60b0b172-7f2e-432c-bc5d-a0f892ea9775 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1314 microversion: 2.1 time: 0.191973 Jul 28 04:00:48.412520 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 119/212] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:48 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:48.414073 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-2661648c-4f3c-416c-9327-d185db194831 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1270 microversion: 2.1 time: 0.094232 Jul 28 04:00:48.414642 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 94/213] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:48 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1270 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:48.430813 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8944470b-b562-4070-8ad1-c47f0df8f4e8 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:48.431656 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8944470b-b562-4070-8ad1-c47f0df8f4e8 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:48.439335 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8944470b-b562-4070-8ad1-c47f0df8f4e8 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:48.439785 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8944470b-b562-4070-8ad1-c47f0df8f4e8 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:48.440561 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8944470b-b562-4070-8ad1-c47f0df8f4e8 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:48.441000 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8944470b-b562-4070-8ad1-c47f0df8f4e8 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:48.584099 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8944470b-b562-4070-8ad1-c47f0df8f4e8 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:48.593739 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8944470b-b562-4070-8ad1-c47f0df8f4e8 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.179708 Jul 28 04:00:48.594612 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 120/214] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:48 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:49.066340 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-82188a69-6929-4bc4-9062-edc3d4d83f1a tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:49.067003 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-82188a69-6929-4bc4-9062-edc3d4d83f1a tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:49.073175 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-82188a69-6929-4bc4-9062-edc3d4d83f1a tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:49.073623 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-82188a69-6929-4bc4-9062-edc3d4d83f1a tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:49.074386 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-82188a69-6929-4bc4-9062-edc3d4d83f1a tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:49.074870 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-82188a69-6929-4bc4-9062-edc3d4d83f1a tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:49.340836 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell0:SELECT=4 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:49.361234 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell0:SELECT=12 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:49.435702 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e2c7d122-7869-4cdd-bffc-bcbf13e0d8f5 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:49.436861 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e2c7d122-7869-4cdd-bffc-bcbf13e0d8f5 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:49.444495 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e2c7d122-7869-4cdd-bffc-bcbf13e0d8f5 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:49.445028 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e2c7d122-7869-4cdd-bffc-bcbf13e0d8f5 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:49.446031 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e2c7d122-7869-4cdd-bffc-bcbf13e0d8f5 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:49.446539 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e2c7d122-7869-4cdd-bffc-bcbf13e0d8f5 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:49.518049 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e2c7d122-7869-4cdd-bffc-bcbf13e0d8f5 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:49.525372 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-82188a69-6929-4bc4-9062-edc3d4d83f1a tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:49.525983 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e2c7d122-7869-4cdd-bffc-bcbf13e0d8f5 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1276 microversion: 2.1 time: 0.093954 Jul 28 04:00:49.526575 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 121/215] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:49 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1276 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:49.547461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-81736097-1b05-47a3-9843-3fe4d8a54522 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:49.547461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-81736097-1b05-47a3-9843-3fe4d8a54522 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:49.553755 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-82188a69-6929-4bc4-9062-edc3d4d83f1a tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1554 microversion: 2.1 time: 0.491269 Jul 28 04:00:49.555130 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 95/216] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:49 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1554 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:49.555714 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-81736097-1b05-47a3-9843-3fe4d8a54522 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:49.556172 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-81736097-1b05-47a3-9843-3fe4d8a54522 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:49.556978 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-81736097-1b05-47a3-9843-3fe4d8a54522 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:49.557438 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-81736097-1b05-47a3-9843-3fe4d8a54522 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:49.609390 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=4 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:49.617423 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c8c1d801-aeba-4aeb-abe2-17a0bb2c2f19 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:49.621769 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c8c1d801-aeba-4aeb-abe2-17a0bb2c2f19 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:49.632319 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c8c1d801-aeba-4aeb-abe2-17a0bb2c2f19 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:49.632776 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c8c1d801-aeba-4aeb-abe2-17a0bb2c2f19 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:49.633693 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c8c1d801-aeba-4aeb-abe2-17a0bb2c2f19 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:49.634165 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c8c1d801-aeba-4aeb-abe2-17a0bb2c2f19 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:49.739999 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-81736097-1b05-47a3-9843-3fe4d8a54522 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:49.748968 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-81736097-1b05-47a3-9843-3fe4d8a54522 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1314 microversion: 2.1 time: 0.221242 Jul 28 04:00:49.752049 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 122/217] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:49 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:50.110204 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-c8c1d801-aeba-4aeb-abe2-17a0bb2c2f19 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:50.119135 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-c8c1d801-aeba-4aeb-abe2-17a0bb2c2f19 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.507680 Jul 28 04:00:50.119806 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 96/218] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:49 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:50.401652 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-e7a8bd78-f48e-424e-b41b-4faca7deaff2 req-8a1c5a0a-ef32-44ec-a7aa-375423e69f29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f962971f-7600-40e0-9c46-257d1aa54ec0", "name": "network-vif-deleted", "tag": "69a10956-82b0-477c-a7f6-0a2b2734d31e"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:50.414739 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-e7a8bd78-f48e-424e-b41b-4faca7deaff2 req-8a1c5a0a-ef32-44ec-a7aa-375423e69f29 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:50.415007 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-e7a8bd78-f48e-424e-b41b-4faca7deaff2 req-8a1c5a0a-ef32-44ec-a7aa-375423e69f29 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:50.428200 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-e7a8bd78-f48e-424e-b41b-4faca7deaff2 req-8a1c5a0a-ef32-44ec-a7aa-375423e69f29 service nova] Creating event network-vif-deleted:69a10956-82b0-477c-a7f6-0a2b2734d31e for instance f962971f-7600-40e0-9c46-257d1aa54ec0 on hv-cinder-79987 Jul 28 04:00:50.434740 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-e7a8bd78-f48e-424e-b41b-4faca7deaff2 req-8a1c5a0a-ef32-44ec-a7aa-375423e69f29 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036621 Jul 28 04:00:50.435871 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 123/219] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:50.555124 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-54ac464c-a2df-4310-8eb7-fd949ddd300f tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:50.556408 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-54ac464c-a2df-4310-8eb7-fd949ddd300f tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:50.564227 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-54ac464c-a2df-4310-8eb7-fd949ddd300f tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:50.564645 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-54ac464c-a2df-4310-8eb7-fd949ddd300f tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:50.565408 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-54ac464c-a2df-4310-8eb7-fd949ddd300f tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:50.565830 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-54ac464c-a2df-4310-8eb7-fd949ddd300f tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:50.577495 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f0857441-1024-4a58-9003-16ed3d66bfae tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:50.578692 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f0857441-1024-4a58-9003-16ed3d66bfae tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:50.593909 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f0857441-1024-4a58-9003-16ed3d66bfae tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:50.594545 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f0857441-1024-4a58-9003-16ed3d66bfae tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:50.595515 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f0857441-1024-4a58-9003-16ed3d66bfae tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:50.595945 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f0857441-1024-4a58-9003-16ed3d66bfae tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:50.670178 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f0857441-1024-4a58-9003-16ed3d66bfae tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:50.682801 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f0857441-1024-4a58-9003-16ed3d66bfae tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1512 microversion: 2.1 time: 0.110382 Jul 28 04:00:50.684600 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 124/220] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:50 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1512 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:50.763755 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-54ac464c-a2df-4310-8eb7-fd949ddd300f tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:50.772816 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-54ac464c-a2df-4310-8eb7-fd949ddd300f tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1318 microversion: 2.1 time: 0.220998 Jul 28 04:00:50.773779 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a1b2530b-987c-466b-bda6-628388092566 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:50.787189 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 97/221] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:50 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:50.787357 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a1b2530b-987c-466b-bda6-628388092566 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:50.787357 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a1b2530b-987c-466b-bda6-628388092566 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:50.787357 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a1b2530b-987c-466b-bda6-628388092566 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:50.787357 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a1b2530b-987c-466b-bda6-628388092566 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:50.787625 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a1b2530b-987c-466b-bda6-628388092566 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:50.923262 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a1b2530b-987c-466b-bda6-628388092566 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:50.931352 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a1b2530b-987c-466b-bda6-628388092566 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1314 microversion: 2.1 time: 0.161425 Jul 28 04:00:50.931930 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 125/222] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:50 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:51.141167 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-ec19a15d-5c7d-4455-b1c0-53620d408fee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:51.141787 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-ec19a15d-5c7d-4455-b1c0-53620d408fee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:51.148231 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ec19a15d-5c7d-4455-b1c0-53620d408fee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:51.148606 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ec19a15d-5c7d-4455-b1c0-53620d408fee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:51.149369 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ec19a15d-5c7d-4455-b1c0-53620d408fee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:51.149800 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ec19a15d-5c7d-4455-b1c0-53620d408fee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:51.300609 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-ec19a15d-5c7d-4455-b1c0-53620d408fee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:51.309362 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-ec19a15d-5c7d-4455-b1c0-53620d408fee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.172482 Jul 28 04:00:51.310282 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 98/223] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:51 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:51.704407 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e04a83a1-8c1a-4a00-b510-ad58ba18a6b9 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:51.705099 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e04a83a1-8c1a-4a00-b510-ad58ba18a6b9 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:51.711209 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e04a83a1-8c1a-4a00-b510-ad58ba18a6b9 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:51.711741 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e04a83a1-8c1a-4a00-b510-ad58ba18a6b9 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:51.712390 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e04a83a1-8c1a-4a00-b510-ad58ba18a6b9 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:51.712817 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e04a83a1-8c1a-4a00-b510-ad58ba18a6b9 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:51.775124 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e04a83a1-8c1a-4a00-b510-ad58ba18a6b9 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:51.787457 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e04a83a1-8c1a-4a00-b510-ad58ba18a6b9 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1346 microversion: 2.1 time: 0.087338 Jul 28 04:00:51.788497 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 126/224] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:51 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:51.797920 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-bdd97977-00d2-4ff6-9f6d-822960f36b37 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:51.799266 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-bdd97977-00d2-4ff6-9f6d-822960f36b37 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:51.806261 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bdd97977-00d2-4ff6-9f6d-822960f36b37 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:51.806795 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bdd97977-00d2-4ff6-9f6d-822960f36b37 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:51.807647 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bdd97977-00d2-4ff6-9f6d-822960f36b37 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:51.808084 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bdd97977-00d2-4ff6-9f6d-822960f36b37 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:51.939128 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-bdd97977-00d2-4ff6-9f6d-822960f36b37 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:51.946887 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-bdd97977-00d2-4ff6-9f6d-822960f36b37 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1318 microversion: 2.1 time: 0.153245 Jul 28 04:00:51.947687 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 99/225] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:51 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:51.953490 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-92bd05c5-ff4c-41db-8564-ff908be91621 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:51.954116 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-92bd05c5-ff4c-41db-8564-ff908be91621 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:51.960055 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-92bd05c5-ff4c-41db-8564-ff908be91621 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:51.960503 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-92bd05c5-ff4c-41db-8564-ff908be91621 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:51.961262 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-92bd05c5-ff4c-41db-8564-ff908be91621 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:51.961723 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-92bd05c5-ff4c-41db-8564-ff908be91621 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:52.090766 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-92bd05c5-ff4c-41db-8564-ff908be91621 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:52.098998 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-92bd05c5-ff4c-41db-8564-ff908be91621 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1314 microversion: 2.1 time: 0.149789 Jul 28 04:00:52.099973 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 127/226] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:51 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:00:52.330969 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-016d2c1d-f597-4017-928e-31ee81ff472e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:52.331736 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-016d2c1d-f597-4017-928e-31ee81ff472e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:52.337705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-016d2c1d-f597-4017-928e-31ee81ff472e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:52.338159 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-016d2c1d-f597-4017-928e-31ee81ff472e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:52.338964 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-016d2c1d-f597-4017-928e-31ee81ff472e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:52.339401 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-016d2c1d-f597-4017-928e-31ee81ff472e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:52.450813 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-f3afc506-e737-4440-826f-69254bb8ca3c req-208c9ec9-99e2-4de5-baf4-174b80eafd11 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b18d0cca-8107-4e73-aa63-0382b7c23bc4", "tag": "d3cd7fac-141b-40c6-8d9d-79ecb5d79c9f"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:52.461541 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-f3afc506-e737-4440-826f-69254bb8ca3c req-208c9ec9-99e2-4de5-baf4-174b80eafd11 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:52.462002 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-f3afc506-e737-4440-826f-69254bb8ca3c req-208c9ec9-99e2-4de5-baf4-174b80eafd11 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:52.474709 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-f3afc506-e737-4440-826f-69254bb8ca3c req-208c9ec9-99e2-4de5-baf4-174b80eafd11 service nova] Creating event network-changed:d3cd7fac-141b-40c6-8d9d-79ecb5d79c9f for instance b18d0cca-8107-4e73-aa63-0382b7c23bc4 on hv-cinder-79987 Jul 28 04:00:52.480616 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-f3afc506-e737-4440-826f-69254bb8ca3c req-208c9ec9-99e2-4de5-baf4-174b80eafd11 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033533 Jul 28 04:00:52.481128 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-016d2c1d-f597-4017-928e-31ee81ff472e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:52.481513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 128/227] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:00:52.489721 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-016d2c1d-f597-4017-928e-31ee81ff472e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.162873 Jul 28 04:00:52.490442 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 100/228] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:52 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:52.809924 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-137596e7-8f87-486a-a7bb-ef55ad2d061e tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:52.810733 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-137596e7-8f87-486a-a7bb-ef55ad2d061e tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:52.817835 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-137596e7-8f87-486a-a7bb-ef55ad2d061e tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:52.818284 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-137596e7-8f87-486a-a7bb-ef55ad2d061e tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:52.819254 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-137596e7-8f87-486a-a7bb-ef55ad2d061e tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:52.819693 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-137596e7-8f87-486a-a7bb-ef55ad2d061e tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:52.883257 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-137596e7-8f87-486a-a7bb-ef55ad2d061e tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:52.891553 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-137596e7-8f87-486a-a7bb-ef55ad2d061e tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1346 microversion: 2.1 time: 0.086053 Jul 28 04:00:52.892112 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 129/229] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:52 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1346 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:52.968152 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-44fa3a0b-a584-4fed-bf90-65c44af02c26 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:52.968708 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-44fa3a0b-a584-4fed-bf90-65c44af02c26 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:52.979508 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-44fa3a0b-a584-4fed-bf90-65c44af02c26 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:52.979973 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-44fa3a0b-a584-4fed-bf90-65c44af02c26 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:52.980746 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-44fa3a0b-a584-4fed-bf90-65c44af02c26 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:52.981184 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-44fa3a0b-a584-4fed-bf90-65c44af02c26 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:52.996150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=100 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:53.120269 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-54093444-5fa8-475c-bfc5-e04414e345dc tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:53.121304 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-54093444-5fa8-475c-bfc5-e04414e345dc tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:53.128475 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-54093444-5fa8-475c-bfc5-e04414e345dc tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:53.129034 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-54093444-5fa8-475c-bfc5-e04414e345dc tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:53.130257 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-54093444-5fa8-475c-bfc5-e04414e345dc tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:53.131093 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-54093444-5fa8-475c-bfc5-e04414e345dc tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:53.274538 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-54093444-5fa8-475c-bfc5-e04414e345dc tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:53.283054 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-54093444-5fa8-475c-bfc5-e04414e345dc tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1314 microversion: 2.1 time: 0.166910 Jul 28 04:00:53.285517 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 130/230] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:53 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:53.299988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-44fa3a0b-a584-4fed-bf90-65c44af02c26 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:53.308457 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-44fa3a0b-a584-4fed-bf90-65c44af02c26 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1318 microversion: 2.1 time: 0.344034 Jul 28 04:00:53.309677 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 101/231] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:52 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1318 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:53.510989 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c062e185-6a73-4507-b620-3a06f2df6fca tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:53.511606 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c062e185-6a73-4507-b620-3a06f2df6fca tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:53.521642 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c062e185-6a73-4507-b620-3a06f2df6fca tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:53.534067 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c062e185-6a73-4507-b620-3a06f2df6fca tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:53.534903 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c062e185-6a73-4507-b620-3a06f2df6fca tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:53.535351 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c062e185-6a73-4507-b620-3a06f2df6fca tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:53.694066 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c062e185-6a73-4507-b620-3a06f2df6fca tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:53.706520 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c062e185-6a73-4507-b620-3a06f2df6fca tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.199309 Jul 28 04:00:53.707908 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 131/232] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:53 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:53.912707 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a65098a8-53d9-4d36-8244-bdd429dd4021 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:53.913583 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-a65098a8-53d9-4d36-8244-bdd429dd4021 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:53.940336 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a65098a8-53d9-4d36-8244-bdd429dd4021 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:53.940922 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a65098a8-53d9-4d36-8244-bdd429dd4021 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:53.942168 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a65098a8-53d9-4d36-8244-bdd429dd4021 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:53.942646 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a65098a8-53d9-4d36-8244-bdd429dd4021 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:53.994972 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a65098a8-53d9-4d36-8244-bdd429dd4021 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:53.995600 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a65098a8-53d9-4d36-8244-bdd429dd4021 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:53.995868 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.objects.instance [None req-a65098a8-53d9-4d36-8244-bdd429dd4021 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lazy-loading 'fault' on Instance uuid f962971f-7600-40e0-9c46-257d1aa54ec0 {{(pid=118186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:00:54.093888 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-a65098a8-53d9-4d36-8244-bdd429dd4021 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd09411d75019428a922e12e02c72f4af', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cb2697d81b164ddfbb33acd843f461f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:54.103171 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-a65098a8-53d9-4d36-8244-bdd429dd4021 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 200 len: 1351 microversion: 2.1 time: 0.194329 Jul 28 04:00:54.103767 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 102/233] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:53 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 1351 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:54.305763 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-1d53c24b-33c5-4e97-b32f-21ce0baf117c tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:54.306430 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-1d53c24b-33c5-4e97-b32f-21ce0baf117c tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:54.314934 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1d53c24b-33c5-4e97-b32f-21ce0baf117c tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:54.315385 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1d53c24b-33c5-4e97-b32f-21ce0baf117c tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:54.316160 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1d53c24b-33c5-4e97-b32f-21ce0baf117c tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:54.316592 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1d53c24b-33c5-4e97-b32f-21ce0baf117c tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:54.333041 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-8df86a86-aadb-4aef-b425-94d8787fd4b2 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:54.333648 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-8df86a86-aadb-4aef-b425-94d8787fd4b2 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:54.342101 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8df86a86-aadb-4aef-b425-94d8787fd4b2 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:54.343233 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8df86a86-aadb-4aef-b425-94d8787fd4b2 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:54.344013 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8df86a86-aadb-4aef-b425-94d8787fd4b2 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:54.344444 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8df86a86-aadb-4aef-b425-94d8787fd4b2 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:54.472012 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1d53c24b-33c5-4e97-b32f-21ce0baf117c tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:54.480224 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-1d53c24b-33c5-4e97-b32f-21ce0baf117c tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1314 microversion: 2.1 time: 0.178539 Jul 28 04:00:54.493757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 132/234] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:54 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:54.583992 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-ff1b6978-b9db-43e3-9865-053bfc1dde97 req-51d509d3-6e42-4550-97c1-476fdbc287e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "29e220bf-3787-43ae-9151-849afd7d4f91", "tag": "ff3a6072-93da-4605-92c6-29a2c45cb25c"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:00:54.595113 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-ff1b6978-b9db-43e3-9865-053bfc1dde97 req-51d509d3-6e42-4550-97c1-476fdbc287e2 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:54.595558 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-ff1b6978-b9db-43e3-9865-053bfc1dde97 req-51d509d3-6e42-4550-97c1-476fdbc287e2 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:54.606842 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-ff1b6978-b9db-43e3-9865-053bfc1dde97 req-51d509d3-6e42-4550-97c1-476fdbc287e2 service nova] Creating event network-changed:ff3a6072-93da-4605-92c6-29a2c45cb25c for instance 29e220bf-3787-43ae-9151-849afd7d4f91 on hv-cinder-79987 Jul 28 04:00:54.612297 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-ff1b6978-b9db-43e3-9865-053bfc1dde97 req-51d509d3-6e42-4550-97c1-476fdbc287e2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032510 Jul 28 04:00:54.612896 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 133/235] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:00:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:00:54.669598 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-8df86a86-aadb-4aef-b425-94d8787fd4b2 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:54.678132 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-8df86a86-aadb-4aef-b425-94d8787fd4b2 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1318 microversion: 2.1 time: 0.348907 Jul 28 04:00:54.678803 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 103/236] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:54 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1318 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:54.728800 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-91c497da-e1c1-4d0c-a3f8-7b972f4773f7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:54.729606 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-91c497da-e1c1-4d0c-a3f8-7b972f4773f7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:54.736576 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-91c497da-e1c1-4d0c-a3f8-7b972f4773f7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:54.737022 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-91c497da-e1c1-4d0c-a3f8-7b972f4773f7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:54.737784 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-91c497da-e1c1-4d0c-a3f8-7b972f4773f7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:54.738222 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-91c497da-e1c1-4d0c-a3f8-7b972f4773f7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:54.876017 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-91c497da-e1c1-4d0c-a3f8-7b972f4773f7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:54.883843 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-91c497da-e1c1-4d0c-a3f8-7b972f4773f7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.159266 Jul 28 04:00:54.884625 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 134/237] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:54 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:55.124720 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-7c6f5d19-4052-4d08-b41d-8c70f397beba tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:55.125335 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-7c6f5d19-4052-4d08-b41d-8c70f397beba tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:55.131668 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7c6f5d19-4052-4d08-b41d-8c70f397beba tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:55.132114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7c6f5d19-4052-4d08-b41d-8c70f397beba tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:55.132899 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7c6f5d19-4052-4d08-b41d-8c70f397beba tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:55.133327 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7c6f5d19-4052-4d08-b41d-8c70f397beba tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:55.148263 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.wsgi [None req-7c6f5d19-4052-4d08-b41d-8c70f397beba tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] HTTP exception thrown: Instance f962971f-7600-40e0-9c46-257d1aa54ec0 could not be found. Jul 28 04:00:55.157572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-7c6f5d19-4052-4d08-b41d-8c70f397beba tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Request method failure captured: Jul 28 04:00:55.157572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: request: GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 HTTP/1.1 Jul 28 04:00:55.157572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept: application/json Jul 28 04:00:55.157572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept-Encoding: identity Jul 28 04:00:55.157572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Connection: close Jul 28 04:00:55.157572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Length: 0 Jul 28 04:00:55.157572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Type: application/json Jul 28 04:00:55.157572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Host: 10.222.0.46 Jul 28 04:00:55.157572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Openstack-System-Scope: None Jul 28 04:00:55.157572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:55.157572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Auth-Token: gAAAAABi4gmrA5c_s8ZGxAy1s0lkmMJyT5lAMTuvwi5cjFyryfccumGTJFCZwz-dpElsgf2bDOBnOx6N-QR9FpXxf7vr5oZRBxkdwse4cqieI-18VujtorAkmau0uCBkaLqm-CNyJi5tKx9HeqQl1q9cCR0sQGWkYf7YJXqxkSis3LvmdeUPfbE Jul 28 04:00:55.157572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Id: None Jul 28 04:00:55.157572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Name: None Jul 28 04:00:55.157572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Identity-Status: Confirmed Jul 28 04:00:55.157572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Is-Admin-Project: True Jul 28 04:00:55.157572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Id: default Jul 28 04:00:55.157572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Name: Default Jul 28 04:00:55.157572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Id: cb2697d81b164ddfbb33acd843f461f6 Jul 28 04:00:55.157572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Name: tempest-DeleteServersTestJSON-166796931 Jul 28 04:00:55.157572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Role: reader,member Jul 28 04:00:55.157572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Roles: reader,member Jul 28 04:00:55.158951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cb2697d81b164ddfbb33acd843f461f6", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cb2697d81b164ddfbb33acd843f461f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cb2697d81b164ddfbb33acd843f461f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cb2697d81b164ddfbb33acd843f461f6"}]}] Jul 28 04:00:55.158951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant: tempest-DeleteServersTestJSON-166796931 Jul 28 04:00:55.158951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Id: cb2697d81b164ddfbb33acd843f461f6 Jul 28 04:00:55.158951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Name: tempest-DeleteServersTestJSON-166796931 Jul 28 04:00:55.158951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User: tempest-DeleteServersTestJSON-166796931-project Jul 28 04:00:55.158951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Id: default Jul 28 04:00:55.158951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Name: Default Jul 28 04:00:55.158951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Id: d09411d75019428a922e12e02c72f4af Jul 28 04:00:55.158951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Name: tempest-DeleteServersTestJSON-166796931-project Jul 28 04:00:55.158951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: method: > Jul 28 04:00:55.158951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: exception: Instance f962971f-7600-40e0-9c46-257d1aa54ec0 could not be found. Jul 28 04:00:55.158951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: action_args: {'id': 'f962971f-7600-40e0-9c46-257d1aa54ec0'} Jul 28 04:00:55.159823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:55.159823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:55.159823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:00:55.159823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:00:55.159823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:00:55.159823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:00:55.159823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:00:55.159823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:00:55.159823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:00:55.159823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:00:55.159823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f962971f-7600-40e0-9c46-257d1aa54ec0 could not be found. Jul 28 04:00:55.159823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:00:55.159823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:55.159823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:00:55.159823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:55.159823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:55.159823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:55.159823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:55.159823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:55.159823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:55.161115 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:55.161115 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:00:55.161115 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:00:55.161115 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:00:55.161115 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:00:55.161115 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:00:55.161115 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:00:55.161115 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f962971f-7600-40e0-9c46-257d1aa54ec0 could not be found. Jul 28 04:00:55.161115 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:00:55.161115 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:55.161115 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:00:55.161115 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:55.161115 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:55.161115 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:55.161115 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:00:55.161115 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:00:55.161115 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f962971f-7600-40e0-9c46-257d1aa54ec0 could not be found. Jul 28 04:00:55.161115 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:00:55.163261 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-7c6f5d19-4052-4d08-b41d-8c70f397beba tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Returning 404 to user: Instance f962971f-7600-40e0-9c46-257d1aa54ec0 could not be found. {{(pid=118186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:55.164123 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-7c6f5d19-4052-4d08-b41d-8c70f397beba tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 404 len: 111 microversion: 2.1 time: 0.043579 Jul 28 04:00:55.164911 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 104/238] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:55 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:00:55.276910 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8f3f239a-52c6-4779-8668-05c6d7612472 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:55.279155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8f3f239a-52c6-4779-8668-05c6d7612472 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:55.285492 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8f3f239a-52c6-4779-8668-05c6d7612472 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:55.285934 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8f3f239a-52c6-4779-8668-05c6d7612472 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:55.286702 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8f3f239a-52c6-4779-8668-05c6d7612472 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:55.287148 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8f3f239a-52c6-4779-8668-05c6d7612472 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:55.299855 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-8f3f239a-52c6-4779-8668-05c6d7612472 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] HTTP exception thrown: Instance f962971f-7600-40e0-9c46-257d1aa54ec0 could not be found. Jul 28 04:00:55.304012 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8f3f239a-52c6-4779-8668-05c6d7612472 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Request method failure captured: Jul 28 04:00:55.304012 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0/os-volume_attachments HTTP/1.1 Jul 28 04:00:55.304012 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:00:55.304012 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:00:55.304012 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:00:55.304012 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:00:55.304012 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:00:55.304012 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:00:55.304012 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:00:55.304012 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:00:55.304012 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gmrA5c_s8ZGxAy1s0lkmMJyT5lAMTuvwi5cjFyryfccumGTJFCZwz-dpElsgf2bDOBnOx6N-QR9FpXxf7vr5oZRBxkdwse4cqieI-18VujtorAkmau0uCBkaLqm-CNyJi5tKx9HeqQl1q9cCR0sQGWkYf7YJXqxkSis3LvmdeUPfbE Jul 28 04:00:55.304012 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:00:55.304012 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:00:55.304012 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:00:55.304012 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:00:55.304012 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:00:55.304012 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:00:55.304012 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: cb2697d81b164ddfbb33acd843f461f6 Jul 28 04:00:55.304012 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-DeleteServersTestJSON-166796931 Jul 28 04:00:55.304012 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:00:55.304012 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:00:55.305418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cb2697d81b164ddfbb33acd843f461f6", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cb2697d81b164ddfbb33acd843f461f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cb2697d81b164ddfbb33acd843f461f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cb2697d81b164ddfbb33acd843f461f6"}]}] Jul 28 04:00:55.305418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-DeleteServersTestJSON-166796931 Jul 28 04:00:55.305418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: cb2697d81b164ddfbb33acd843f461f6 Jul 28 04:00:55.305418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-DeleteServersTestJSON-166796931 Jul 28 04:00:55.305418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-DeleteServersTestJSON-166796931-project Jul 28 04:00:55.305418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:00:55.305418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:00:55.305418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: d09411d75019428a922e12e02c72f4af Jul 28 04:00:55.305418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-DeleteServersTestJSON-166796931-project Jul 28 04:00:55.305418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:00:55.305418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Instance f962971f-7600-40e0-9c46-257d1aa54ec0 could not be found. Jul 28 04:00:55.305418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'server_id': 'f962971f-7600-40e0-9c46-257d1aa54ec0'} Jul 28 04:00:55.306617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:00:55.306617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:55.306617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:00:55.306617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:00:55.306617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:00:55.306617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:00:55.306617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:00:55.306617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:00:55.306617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:00:55.306617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:00:55.306617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f962971f-7600-40e0-9c46-257d1aa54ec0 could not be found. Jul 28 04:00:55.306617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:00:55.306617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:55.306617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:00:55.306617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:55.306617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:55.306617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:55.306617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:00:55.306617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:00:55.306617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:00:55.308324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:00:55.308324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 04:00:55.308324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:00:55.308324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 28 04:00:55.308324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:00:55.308324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 28 04:00:55.308324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 28 04:00:55.308324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:00:55.308324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:00:55.308324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f962971f-7600-40e0-9c46-257d1aa54ec0 could not be found. Jul 28 04:00:55.308324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:00:55.308324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:00:55.308324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:00:55.308324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:00:55.308324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:00:55.308324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:00:55.308324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:00:55.308324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:00:55.308324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f962971f-7600-40e0-9c46-257d1aa54ec0 could not be found. Jul 28 04:00:55.308324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:00:55.309339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8f3f239a-52c6-4779-8668-05c6d7612472 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Returning 404 to user: Instance f962971f-7600-40e0-9c46-257d1aa54ec0 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:00:55.309339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8f3f239a-52c6-4779-8668-05c6d7612472 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032620 Jul 28 04:00:55.309339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 135/239] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Jul 28 04:00:55 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0/os-volume_attachments => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:00:55.500914 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-be7c51eb-1292-4734-85ad-5982cfc4c0ac tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:55.501535 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-be7c51eb-1292-4734-85ad-5982cfc4c0ac tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:55.507612 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-be7c51eb-1292-4734-85ad-5982cfc4c0ac tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:55.508058 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-be7c51eb-1292-4734-85ad-5982cfc4c0ac tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:55.508816 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-be7c51eb-1292-4734-85ad-5982cfc4c0ac tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:55.509252 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-be7c51eb-1292-4734-85ad-5982cfc4c0ac tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:55.640431 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-be7c51eb-1292-4734-85ad-5982cfc4c0ac tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:55.647820 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-be7c51eb-1292-4734-85ad-5982cfc4c0ac tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1314 microversion: 2.1 time: 0.150987 Jul 28 04:00:55.648390 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 105/240] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:55 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:55.699397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fd318286-872e-4f42-b51b-3e3ff2736b53 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:55.700053 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-fd318286-872e-4f42-b51b-3e3ff2736b53 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:55.706777 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fd318286-872e-4f42-b51b-3e3ff2736b53 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:55.707255 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fd318286-872e-4f42-b51b-3e3ff2736b53 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:55.708005 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fd318286-872e-4f42-b51b-3e3ff2736b53 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:55.708437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fd318286-872e-4f42-b51b-3e3ff2736b53 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:55.712555 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=100 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:55.836369 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-fd318286-872e-4f42-b51b-3e3ff2736b53 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:55.844999 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-fd318286-872e-4f42-b51b-3e3ff2736b53 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1318 microversion: 2.1 time: 0.149484 Jul 28 04:00:55.845566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 136/241] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:55 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:55.906143 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-2acddf1d-babf-442a-8288-1137d464e081 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:55.906724 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-2acddf1d-babf-442a-8288-1137d464e081 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:55.912782 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2acddf1d-babf-442a-8288-1137d464e081 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:55.913531 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2acddf1d-babf-442a-8288-1137d464e081 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:55.914296 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2acddf1d-babf-442a-8288-1137d464e081 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:55.914736 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2acddf1d-babf-442a-8288-1137d464e081 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:56.043252 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-2acddf1d-babf-442a-8288-1137d464e081 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:56.051433 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-2acddf1d-babf-442a-8288-1137d464e081 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.149831 Jul 28 04:00:56.051990 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 106/242] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:55 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:56.669039 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-89d380e9-d497-4186-b2ef-8446e53be3c1 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:56.669582 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-89d380e9-d497-4186-b2ef-8446e53be3c1 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:56.675731 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-89d380e9-d497-4186-b2ef-8446e53be3c1 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:56.676179 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-89d380e9-d497-4186-b2ef-8446e53be3c1 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:56.676945 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-89d380e9-d497-4186-b2ef-8446e53be3c1 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:56.677376 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-89d380e9-d497-4186-b2ef-8446e53be3c1 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:56.802005 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-89d380e9-d497-4186-b2ef-8446e53be3c1 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:56.809439 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-89d380e9-d497-4186-b2ef-8446e53be3c1 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1314 microversion: 2.1 time: 0.144393 Jul 28 04:00:56.810034 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 137/243] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:56 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:56.865313 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-dc1cff10-6aa3-42bb-8726-b41cd1493b46 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:56.865924 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-dc1cff10-6aa3-42bb-8726-b41cd1493b46 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:56.871959 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dc1cff10-6aa3-42bb-8726-b41cd1493b46 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:56.872399 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dc1cff10-6aa3-42bb-8726-b41cd1493b46 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:56.873146 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dc1cff10-6aa3-42bb-8726-b41cd1493b46 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:56.873577 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dc1cff10-6aa3-42bb-8726-b41cd1493b46 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:57.001129 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-dc1cff10-6aa3-42bb-8726-b41cd1493b46 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:57.008668 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-dc1cff10-6aa3-42bb-8726-b41cd1493b46 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1318 microversion: 2.1 time: 0.147287 Jul 28 04:00:57.009238 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 107/244] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:56 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:57.071771 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-aee32620-feda-48ce-8a9c-7a39e417f140 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:57.072402 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-aee32620-feda-48ce-8a9c-7a39e417f140 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:57.078389 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aee32620-feda-48ce-8a9c-7a39e417f140 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:57.078865 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aee32620-feda-48ce-8a9c-7a39e417f140 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:57.079616 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aee32620-feda-48ce-8a9c-7a39e417f140 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:57.080044 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aee32620-feda-48ce-8a9c-7a39e417f140 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:57.213622 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-aee32620-feda-48ce-8a9c-7a39e417f140 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:57.221904 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-aee32620-feda-48ce-8a9c-7a39e417f140 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.153910 Jul 28 04:00:57.222466 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 138/245] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:57 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:57.830998 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-e51bd124-5191-4c7d-af06-c4fa8ecfff8f tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:57.831622 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-e51bd124-5191-4c7d-af06-c4fa8ecfff8f tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:57.837650 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e51bd124-5191-4c7d-af06-c4fa8ecfff8f tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:57.838098 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e51bd124-5191-4c7d-af06-c4fa8ecfff8f tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:57.838882 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e51bd124-5191-4c7d-af06-c4fa8ecfff8f tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:57.839319 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e51bd124-5191-4c7d-af06-c4fa8ecfff8f tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:57.966468 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-e51bd124-5191-4c7d-af06-c4fa8ecfff8f tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:57.974513 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-e51bd124-5191-4c7d-af06-c4fa8ecfff8f tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1314 microversion: 2.1 time: 0.147611 Jul 28 04:00:57.975124 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 108/246] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:57 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:58.029001 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fb2d7bf9-6850-46d7-873f-8d83d27fa147 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:58.029618 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-fb2d7bf9-6850-46d7-873f-8d83d27fa147 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:58.036457 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fb2d7bf9-6850-46d7-873f-8d83d27fa147 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:58.036904 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fb2d7bf9-6850-46d7-873f-8d83d27fa147 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:58.037658 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fb2d7bf9-6850-46d7-873f-8d83d27fa147 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:58.038344 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fb2d7bf9-6850-46d7-873f-8d83d27fa147 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:58.163565 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-fb2d7bf9-6850-46d7-873f-8d83d27fa147 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:58.171274 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-fb2d7bf9-6850-46d7-873f-8d83d27fa147 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1318 microversion: 2.1 time: 0.146019 Jul 28 04:00:58.172038 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 139/247] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:58 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:58.243098 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-6751bdbb-2732-4b02-9b50-1c0b523786a9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:58.243708 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-6751bdbb-2732-4b02-9b50-1c0b523786a9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:58.250520 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6751bdbb-2732-4b02-9b50-1c0b523786a9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:58.250991 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6751bdbb-2732-4b02-9b50-1c0b523786a9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:58.251743 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6751bdbb-2732-4b02-9b50-1c0b523786a9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:58.252174 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6751bdbb-2732-4b02-9b50-1c0b523786a9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:58.381912 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-6751bdbb-2732-4b02-9b50-1c0b523786a9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:58.389862 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-6751bdbb-2732-4b02-9b50-1c0b523786a9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.150126 Jul 28 04:00:58.390448 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 109/248] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:58 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:58.995321 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-28185bed-ca96-4a6e-ad7a-c02e8d20545c tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:58.995927 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-28185bed-ca96-4a6e-ad7a-c02e8d20545c tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:58.999396 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=100 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:00:59.003243 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-28185bed-ca96-4a6e-ad7a-c02e8d20545c tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:59.003687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-28185bed-ca96-4a6e-ad7a-c02e8d20545c tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:59.004430 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-28185bed-ca96-4a6e-ad7a-c02e8d20545c tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:59.004859 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-28185bed-ca96-4a6e-ad7a-c02e8d20545c tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:59.133726 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-28185bed-ca96-4a6e-ad7a-c02e8d20545c tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:59.142092 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-28185bed-ca96-4a6e-ad7a-c02e8d20545c tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1314 microversion: 2.1 time: 0.150648 Jul 28 04:00:59.142692 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 140/249] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:58 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:59.191851 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-8281d339-ecad-4d4e-a39e-72d764ee1019 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:59.192768 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-8281d339-ecad-4d4e-a39e-72d764ee1019 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:59.203940 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8281d339-ecad-4d4e-a39e-72d764ee1019 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:59.204392 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8281d339-ecad-4d4e-a39e-72d764ee1019 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:59.205157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8281d339-ecad-4d4e-a39e-72d764ee1019 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:59.205597 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8281d339-ecad-4d4e-a39e-72d764ee1019 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:59.339114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-8281d339-ecad-4d4e-a39e-72d764ee1019 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:59.347663 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-8281d339-ecad-4d4e-a39e-72d764ee1019 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1318 microversion: 2.1 time: 0.159782 Jul 28 04:00:59.348527 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 110/250] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:59 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:00:59.410251 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9bfc601c-b23e-48e1-8a6c-559c2e6f3bd4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:00:59.410915 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9bfc601c-b23e-48e1-8a6c-559c2e6f3bd4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:00:59.418078 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9bfc601c-b23e-48e1-8a6c-559c2e6f3bd4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:59.418530 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9bfc601c-b23e-48e1-8a6c-559c2e6f3bd4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:59.419320 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9bfc601c-b23e-48e1-8a6c-559c2e6f3bd4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:00:59.419802 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9bfc601c-b23e-48e1-8a6c-559c2e6f3bd4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:00:59.553700 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9bfc601c-b23e-48e1-8a6c-559c2e6f3bd4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:00:59.564329 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9bfc601c-b23e-48e1-8a6c-559c2e6f3bd4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.158084 Jul 28 04:00:59.564915 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 141/251] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:00:59 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:00.163111 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-0e2d8dc7-053b-419e-8ff9-899b76b1f930 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:00.163722 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-0e2d8dc7-053b-419e-8ff9-899b76b1f930 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:00.169736 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0e2d8dc7-053b-419e-8ff9-899b76b1f930 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:00.170177 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0e2d8dc7-053b-419e-8ff9-899b76b1f930 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:00.171632 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0e2d8dc7-053b-419e-8ff9-899b76b1f930 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:00.172061 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0e2d8dc7-053b-419e-8ff9-899b76b1f930 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:00.302923 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-0e2d8dc7-053b-419e-8ff9-899b76b1f930 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:00.310653 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-0e2d8dc7-053b-419e-8ff9-899b76b1f930 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1314 microversion: 2.1 time: 0.151579 Jul 28 04:01:00.311362 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 111/252] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:00 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:00.369143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-74db5e67-f907-4f4d-a976-1ca562e6be43 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:00.369746 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-74db5e67-f907-4f4d-a976-1ca562e6be43 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:00.376014 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-74db5e67-f907-4f4d-a976-1ca562e6be43 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:00.376460 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-74db5e67-f907-4f4d-a976-1ca562e6be43 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:00.377202 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-74db5e67-f907-4f4d-a976-1ca562e6be43 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:00.377628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-74db5e67-f907-4f4d-a976-1ca562e6be43 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:00.506604 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-74db5e67-f907-4f4d-a976-1ca562e6be43 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:00.514175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-74db5e67-f907-4f4d-a976-1ca562e6be43 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1318 microversion: 2.1 time: 0.148629 Jul 28 04:01:00.515272 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 142/253] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:00 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:00.585448 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-f6cf0a56-f2cb-4af8-8d82-829f507ef585 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:00.586060 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-f6cf0a56-f2cb-4af8-8d82-829f507ef585 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:00.592337 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f6cf0a56-f2cb-4af8-8d82-829f507ef585 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:00.593121 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f6cf0a56-f2cb-4af8-8d82-829f507ef585 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:00.593884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f6cf0a56-f2cb-4af8-8d82-829f507ef585 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:00.594320 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f6cf0a56-f2cb-4af8-8d82-829f507ef585 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:00.722357 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-f6cf0a56-f2cb-4af8-8d82-829f507ef585 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:00.729699 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-f6cf0a56-f2cb-4af8-8d82-829f507ef585 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.148063 Jul 28 04:01:00.730272 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 112/254] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:00 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:01.331627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fdecfeac-d142-474c-a787-1ee6610e7485 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:01.332232 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-fdecfeac-d142-474c-a787-1ee6610e7485 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:01.338427 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fdecfeac-d142-474c-a787-1ee6610e7485 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:01.338909 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fdecfeac-d142-474c-a787-1ee6610e7485 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:01.339668 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fdecfeac-d142-474c-a787-1ee6610e7485 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:01.340101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fdecfeac-d142-474c-a787-1ee6610e7485 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:01.464006 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-fdecfeac-d142-474c-a787-1ee6610e7485 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:01.471586 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-fdecfeac-d142-474c-a787-1ee6610e7485 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1314 microversion: 2.1 time: 0.144733 Jul 28 04:01:01.472157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 143/255] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:01 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:01.538193 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-fd3eacfd-bc7b-4263-a07c-056a3b1b95d4 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:01.538193 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-fd3eacfd-bc7b-4263-a07c-056a3b1b95d4 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:01.542665 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fd3eacfd-bc7b-4263-a07c-056a3b1b95d4 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:01.543154 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fd3eacfd-bc7b-4263-a07c-056a3b1b95d4 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:01.543987 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fd3eacfd-bc7b-4263-a07c-056a3b1b95d4 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:01.544425 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fd3eacfd-bc7b-4263-a07c-056a3b1b95d4 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:01.672616 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-fd3eacfd-bc7b-4263-a07c-056a3b1b95d4 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:01.680090 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-fd3eacfd-bc7b-4263-a07c-056a3b1b95d4 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1318 microversion: 2.1 time: 0.148678 Jul 28 04:01:01.680696 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 113/256] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:01 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:01.750933 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a107d140-04bc-4087-aa50-de863c4fe024 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:01.751550 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a107d140-04bc-4087-aa50-de863c4fe024 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:01.757566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a107d140-04bc-4087-aa50-de863c4fe024 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:01.758023 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a107d140-04bc-4087-aa50-de863c4fe024 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:01.758802 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a107d140-04bc-4087-aa50-de863c4fe024 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:01.759247 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a107d140-04bc-4087-aa50-de863c4fe024 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:01.891388 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a107d140-04bc-4087-aa50-de863c4fe024 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:01.898713 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a107d140-04bc-4087-aa50-de863c4fe024 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.152308 Jul 28 04:01:01.899317 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 144/257] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:01 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:02.492150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-2d3fd485-1692-409c-b7e1-7f0a9d71dd58 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:02.492773 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-2d3fd485-1692-409c-b7e1-7f0a9d71dd58 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:02.494641 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:02.500902 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2d3fd485-1692-409c-b7e1-7f0a9d71dd58 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:02.501352 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2d3fd485-1692-409c-b7e1-7f0a9d71dd58 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:02.502115 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2d3fd485-1692-409c-b7e1-7f0a9d71dd58 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:02.502552 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2d3fd485-1692-409c-b7e1-7f0a9d71dd58 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:02.638878 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-2d3fd485-1692-409c-b7e1-7f0a9d71dd58 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:02.647746 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-2d3fd485-1692-409c-b7e1-7f0a9d71dd58 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1314 microversion: 2.1 time: 0.159421 Jul 28 04:01:02.648247 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 114/258] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:02 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:02.702117 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-40b5fdb0-e3e4-48ea-98d1-c4ad955f9010 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:02.702917 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-40b5fdb0-e3e4-48ea-98d1-c4ad955f9010 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:02.709326 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-40b5fdb0-e3e4-48ea-98d1-c4ad955f9010 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:02.709774 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-40b5fdb0-e3e4-48ea-98d1-c4ad955f9010 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:02.710534 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-40b5fdb0-e3e4-48ea-98d1-c4ad955f9010 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:02.711006 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-40b5fdb0-e3e4-48ea-98d1-c4ad955f9010 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:02.841526 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c26f54e1-cf93-45ac-a813-afe6ccfb78c4 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:02.842030 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c26f54e1-cf93-45ac-a813-afe6ccfb78c4 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:02.844999 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-40b5fdb0-e3e4-48ea-98d1-c4ad955f9010 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:02.848063 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c26f54e1-cf93-45ac-a813-afe6ccfb78c4 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:02.848505 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c26f54e1-cf93-45ac-a813-afe6ccfb78c4 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:02.849503 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c26f54e1-cf93-45ac-a813-afe6ccfb78c4 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:02.849823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c26f54e1-cf93-45ac-a813-afe6ccfb78c4 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:02.857166 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-40b5fdb0-e3e4-48ea-98d1-c4ad955f9010 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1318 microversion: 2.1 time: 0.159330 Jul 28 04:01:02.858302 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 145/259] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:02 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:02.864917 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.wsgi [None req-c26f54e1-cf93-45ac-a813-afe6ccfb78c4 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] HTTP exception thrown: Instance f962971f-7600-40e0-9c46-257d1aa54ec0 could not be found. Jul 28 04:01:02.866462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c26f54e1-cf93-45ac-a813-afe6ccfb78c4 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Request method failure captured: Jul 28 04:01:02.866462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: request: DELETE /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 HTTP/1.1 Jul 28 04:01:02.866462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept: application/json Jul 28 04:01:02.866462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept-Encoding: identity Jul 28 04:01:02.866462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Connection: close Jul 28 04:01:02.866462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Length: 0 Jul 28 04:01:02.866462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Type: application/json Jul 28 04:01:02.866462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Host: 10.222.0.46 Jul 28 04:01:02.866462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Openstack-System-Scope: None Jul 28 04:01:02.866462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: User-Agent: python-urllib3/1.26.10 Jul 28 04:01:02.866462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Auth-Token: gAAAAABi4gmrA5c_s8ZGxAy1s0lkmMJyT5lAMTuvwi5cjFyryfccumGTJFCZwz-dpElsgf2bDOBnOx6N-QR9FpXxf7vr5oZRBxkdwse4cqieI-18VujtorAkmau0uCBkaLqm-CNyJi5tKx9HeqQl1q9cCR0sQGWkYf7YJXqxkSis3LvmdeUPfbE Jul 28 04:01:02.866462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Id: None Jul 28 04:01:02.866462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Name: None Jul 28 04:01:02.866462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Identity-Status: Confirmed Jul 28 04:01:02.866462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Is-Admin-Project: True Jul 28 04:01:02.866462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Id: default Jul 28 04:01:02.866462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Name: Default Jul 28 04:01:02.866462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Id: cb2697d81b164ddfbb33acd843f461f6 Jul 28 04:01:02.866462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Name: tempest-DeleteServersTestJSON-166796931 Jul 28 04:01:02.866462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Role: reader,member Jul 28 04:01:02.866462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Roles: reader,member Jul 28 04:01:02.868122 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cb2697d81b164ddfbb33acd843f461f6", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cb2697d81b164ddfbb33acd843f461f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cb2697d81b164ddfbb33acd843f461f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cb2697d81b164ddfbb33acd843f461f6"}]}] Jul 28 04:01:02.868122 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant: tempest-DeleteServersTestJSON-166796931 Jul 28 04:01:02.868122 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Id: cb2697d81b164ddfbb33acd843f461f6 Jul 28 04:01:02.868122 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Name: tempest-DeleteServersTestJSON-166796931 Jul 28 04:01:02.868122 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User: tempest-DeleteServersTestJSON-166796931-project Jul 28 04:01:02.868122 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Id: default Jul 28 04:01:02.868122 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Name: Default Jul 28 04:01:02.868122 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Id: d09411d75019428a922e12e02c72f4af Jul 28 04:01:02.868122 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Name: tempest-DeleteServersTestJSON-166796931-project Jul 28 04:01:02.868122 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: method: > Jul 28 04:01:02.868122 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: exception: Instance f962971f-7600-40e0-9c46-257d1aa54ec0 could not be found. Jul 28 04:01:02.868122 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: action_args: {'id': 'f962971f-7600-40e0-9c46-257d1aa54ec0'} Jul 28 04:01:02.869066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:01:02.869066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:01:02.869066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:01:02.869066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:01:02.869066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:01:02.869066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:01:02.869066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:01:02.869066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:01:02.869066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:01:02.869066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:01:02.869066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f962971f-7600-40e0-9c46-257d1aa54ec0 could not be found. Jul 28 04:01:02.869066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:01:02.869066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:01:02.869066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:01:02.869066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:01:02.869066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:01:02.869066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:01:02.869066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:01:02.869066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:01:02.869066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:01:02.870197 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:01:02.870197 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:01:02.870197 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:01:02.870197 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:01:02.870197 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:01:02.870197 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:01:02.870197 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:01:02.870197 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:01:02.870197 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:01:02.870197 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f962971f-7600-40e0-9c46-257d1aa54ec0 could not be found. Jul 28 04:01:02.870197 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:01:02.870197 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:01:02.870197 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:01:02.870197 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:01:02.870197 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:01:02.870197 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:01:02.870197 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:01:02.870197 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:01:02.870197 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f962971f-7600-40e0-9c46-257d1aa54ec0 could not be found. Jul 28 04:01:02.870197 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:01:02.871482 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c26f54e1-cf93-45ac-a813-afe6ccfb78c4 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Returning 404 to user: Instance f962971f-7600-40e0-9c46-257d1aa54ec0 could not be found. {{(pid=118186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:01:02.871482 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-c26f54e1-cf93-45ac-a813-afe6ccfb78c4 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 404 len: 111 microversion: 2.1 time: 0.030625 Jul 28 04:01:02.871482 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 115/260] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:01:02 2022] DELETE /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:01:02.880395 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ec5e000a-9969-4c04-8342-54ee25cc0832 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:02.881138 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ec5e000a-9969-4c04-8342-54ee25cc0832 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] [instance: f962971f-7600-40e0-9c46-257d1aa54ec0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:02.888597 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ec5e000a-9969-4c04-8342-54ee25cc0832 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:02.889069 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ec5e000a-9969-4c04-8342-54ee25cc0832 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:02.890762 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ec5e000a-9969-4c04-8342-54ee25cc0832 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:02.891311 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ec5e000a-9969-4c04-8342-54ee25cc0832 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:02.906666 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-ec5e000a-9969-4c04-8342-54ee25cc0832 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] HTTP exception thrown: Instance f962971f-7600-40e0-9c46-257d1aa54ec0 could not be found. Jul 28 04:01:02.908808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ec5e000a-9969-4c04-8342-54ee25cc0832 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Request method failure captured: Jul 28 04:01:02.908808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 HTTP/1.1 Jul 28 04:01:02.908808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:01:02.908808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:01:02.908808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:01:02.908808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:01:02.908808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:01:02.908808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:01:02.908808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:01:02.908808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:01:02.908808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gmrA5c_s8ZGxAy1s0lkmMJyT5lAMTuvwi5cjFyryfccumGTJFCZwz-dpElsgf2bDOBnOx6N-QR9FpXxf7vr5oZRBxkdwse4cqieI-18VujtorAkmau0uCBkaLqm-CNyJi5tKx9HeqQl1q9cCR0sQGWkYf7YJXqxkSis3LvmdeUPfbE Jul 28 04:01:02.908808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:01:02.908808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:01:02.908808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:01:02.908808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:01:02.908808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:01:02.908808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:01:02.908808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: cb2697d81b164ddfbb33acd843f461f6 Jul 28 04:01:02.908808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-DeleteServersTestJSON-166796931 Jul 28 04:01:02.908808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:01:02.908808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:01:02.910285 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_cb2697d81b164ddfbb33acd843f461f6", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cb2697d81b164ddfbb33acd843f461f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/cb2697d81b164ddfbb33acd843f461f6"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/cb2697d81b164ddfbb33acd843f461f6"}]}] Jul 28 04:01:02.910285 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-DeleteServersTestJSON-166796931 Jul 28 04:01:02.910285 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: cb2697d81b164ddfbb33acd843f461f6 Jul 28 04:01:02.910285 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-DeleteServersTestJSON-166796931 Jul 28 04:01:02.910285 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-DeleteServersTestJSON-166796931-project Jul 28 04:01:02.910285 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:01:02.910285 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:01:02.910285 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: d09411d75019428a922e12e02c72f4af Jul 28 04:01:02.910285 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-DeleteServersTestJSON-166796931-project Jul 28 04:01:02.910285 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:01:02.910285 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Instance f962971f-7600-40e0-9c46-257d1aa54ec0 could not be found. Jul 28 04:01:02.910285 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': 'f962971f-7600-40e0-9c46-257d1aa54ec0'} Jul 28 04:01:02.911202 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:01:02.911202 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:01:02.911202 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:01:02.911202 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:01:02.911202 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:01:02.911202 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:01:02.911202 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:01:02.911202 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:01:02.911202 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:01:02.911202 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:01:02.911202 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f962971f-7600-40e0-9c46-257d1aa54ec0 could not be found. Jul 28 04:01:02.911202 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:01:02.911202 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:01:02.911202 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:01:02.911202 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:01:02.911202 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:01:02.911202 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:01:02.911202 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:01:02.911202 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:01:02.911202 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:01:02.912573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:01:02.912573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:01:02.912573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:01:02.912573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:01:02.912573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:01:02.912573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:01:02.912573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:01:02.912573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f962971f-7600-40e0-9c46-257d1aa54ec0 could not be found. Jul 28 04:01:02.912573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:01:02.912573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:01:02.912573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:01:02.912573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:01:02.912573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:01:02.912573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:01:02.912573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:01:02.912573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:01:02.912573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f962971f-7600-40e0-9c46-257d1aa54ec0 could not be found. Jul 28 04:01:02.912573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:01:02.913995 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ec5e000a-9969-4c04-8342-54ee25cc0832 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] Returning 404 to user: Instance f962971f-7600-40e0-9c46-257d1aa54ec0 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:01:02.913995 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ec5e000a-9969-4c04-8342-54ee25cc0832 tempest-DeleteServersTestJSON-166796931 tempest-DeleteServersTestJSON-166796931-project] 10.222.0.46 "GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0" status: 404 len: 111 microversion: 2.1 time: 0.034140 Jul 28 04:01:02.913995 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 146/261] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:02 2022] GET /compute/v2.1/servers/f962971f-7600-40e0-9c46-257d1aa54ec0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:01:02.920804 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-16f588e5-c470-4f76-b336-41e82cbee020 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:02.921893 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-16f588e5-c470-4f76-b336-41e82cbee020 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:02.929071 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-16f588e5-c470-4f76-b336-41e82cbee020 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:02.929549 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-16f588e5-c470-4f76-b336-41e82cbee020 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:02.930449 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-16f588e5-c470-4f76-b336-41e82cbee020 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:02.930921 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-16f588e5-c470-4f76-b336-41e82cbee020 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:03.190951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-16f588e5-c470-4f76-b336-41e82cbee020 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:03.198994 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-16f588e5-c470-4f76-b336-41e82cbee020 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.282466 Jul 28 04:01:03.199784 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 116/262] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:02 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:03.669617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-43d77622-ba2a-4c80-8a03-e19e991e08a5 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:03.670327 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-43d77622-ba2a-4c80-8a03-e19e991e08a5 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:03.677684 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-43d77622-ba2a-4c80-8a03-e19e991e08a5 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:03.678140 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-43d77622-ba2a-4c80-8a03-e19e991e08a5 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:03.678954 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-43d77622-ba2a-4c80-8a03-e19e991e08a5 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:03.679383 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-43d77622-ba2a-4c80-8a03-e19e991e08a5 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:03.819814 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-43d77622-ba2a-4c80-8a03-e19e991e08a5 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:03.830426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-43d77622-ba2a-4c80-8a03-e19e991e08a5 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1314 microversion: 2.1 time: 0.164945 Jul 28 04:01:03.831044 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 147/263] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:03 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:03.877426 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-312a41bb-6ae4-4e66-a091-f4cb7548b877 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:03.878322 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-312a41bb-6ae4-4e66-a091-f4cb7548b877 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:03.885522 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-312a41bb-6ae4-4e66-a091-f4cb7548b877 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:03.886063 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-312a41bb-6ae4-4e66-a091-f4cb7548b877 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:03.886973 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-312a41bb-6ae4-4e66-a091-f4cb7548b877 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:03.887555 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-312a41bb-6ae4-4e66-a091-f4cb7548b877 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:04.221848 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ad3e0836-673f-4a49-9c08-07647329b0cf tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:04.222751 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ad3e0836-673f-4a49-9c08-07647329b0cf tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:04.230375 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ad3e0836-673f-4a49-9c08-07647329b0cf tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:04.231084 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ad3e0836-673f-4a49-9c08-07647329b0cf tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:04.231866 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ad3e0836-673f-4a49-9c08-07647329b0cf tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:04.232313 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ad3e0836-673f-4a49-9c08-07647329b0cf tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:04.477693 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-312a41bb-6ae4-4e66-a091-f4cb7548b877 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:04.486058 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-312a41bb-6ae4-4e66-a091-f4cb7548b877 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1318 microversion: 2.1 time: 0.612468 Jul 28 04:01:04.487024 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 117/264] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:03 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1318 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:04.611629 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ad3e0836-673f-4a49-9c08-07647329b0cf tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:04.619948 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ad3e0836-673f-4a49-9c08-07647329b0cf tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.401913 Jul 28 04:01:04.620926 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 148/265] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:04 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:04.852574 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-863f37ae-85dd-4045-a873-c1f3df3c08c0 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:04.853506 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-863f37ae-85dd-4045-a873-c1f3df3c08c0 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:04.864081 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-863f37ae-85dd-4045-a873-c1f3df3c08c0 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:04.864617 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-863f37ae-85dd-4045-a873-c1f3df3c08c0 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:04.865635 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-863f37ae-85dd-4045-a873-c1f3df3c08c0 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:04.866271 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-863f37ae-85dd-4045-a873-c1f3df3c08c0 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:05.135940 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-863f37ae-85dd-4045-a873-c1f3df3c08c0 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:05.146483 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-863f37ae-85dd-4045-a873-c1f3df3c08c0 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1314 microversion: 2.1 time: 0.297873 Jul 28 04:01:05.159433 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 118/266] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:04 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:05.319718 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-45858f6d-7721-4066-93c2-6f52c3c33906 req-ade5ac55-5c22-4cf6-aff0-14695abc4e01 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b18d0cca-8107-4e73-aa63-0382b7c23bc4", "name": "network-vif-plugged", "status": "completed", "tag": "d3cd7fac-141b-40c6-8d9d-79ecb5d79c9f"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:05.351687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-45858f6d-7721-4066-93c2-6f52c3c33906 req-ade5ac55-5c22-4cf6-aff0-14695abc4e01 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:05.353002 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-45858f6d-7721-4066-93c2-6f52c3c33906 req-ade5ac55-5c22-4cf6-aff0-14695abc4e01 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:05.387970 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-45858f6d-7721-4066-93c2-6f52c3c33906 req-ade5ac55-5c22-4cf6-aff0-14695abc4e01 service nova] Creating event network-vif-plugged:d3cd7fac-141b-40c6-8d9d-79ecb5d79c9f for instance b18d0cca-8107-4e73-aa63-0382b7c23bc4 on hv-cinder-79987 Jul 28 04:01:05.405857 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-45858f6d-7721-4066-93c2-6f52c3c33906 req-ade5ac55-5c22-4cf6-aff0-14695abc4e01 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096068 Jul 28 04:01:05.408568 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 149/267] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:01:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:05.507180 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c5836f56-34dc-4ce7-984a-edc3ce7b4b10 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:05.507857 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c5836f56-34dc-4ce7-984a-edc3ce7b4b10 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:05.522077 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c5836f56-34dc-4ce7-984a-edc3ce7b4b10 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:05.522589 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c5836f56-34dc-4ce7-984a-edc3ce7b4b10 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:05.529331 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c5836f56-34dc-4ce7-984a-edc3ce7b4b10 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:05.529907 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c5836f56-34dc-4ce7-984a-edc3ce7b4b10 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:05.534660 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=100 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:05.641515 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c1a2af27-269e-46a8-b4b6-b263ecfbe06c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:05.653673 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c1a2af27-269e-46a8-b4b6-b263ecfbe06c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:05.672218 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c1a2af27-269e-46a8-b4b6-b263ecfbe06c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:05.673280 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c1a2af27-269e-46a8-b4b6-b263ecfbe06c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:05.675047 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c1a2af27-269e-46a8-b4b6-b263ecfbe06c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:05.676175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c1a2af27-269e-46a8-b4b6-b263ecfbe06c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:05.878553 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c1a2af27-269e-46a8-b4b6-b263ecfbe06c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:05.891719 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c1a2af27-269e-46a8-b4b6-b263ecfbe06c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.252105 Jul 28 04:01:05.893818 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 150/268] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:05 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:05.898717 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-c5836f56-34dc-4ce7-984a-edc3ce7b4b10 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:05.907259 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-c5836f56-34dc-4ce7-984a-edc3ce7b4b10 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1318 microversion: 2.1 time: 0.403955 Jul 28 04:01:05.907840 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 119/269] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:05 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1318 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:06.169041 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5bc7811d-7e02-43c0-95b2-7ed77edf444e tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:06.170004 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5bc7811d-7e02-43c0-95b2-7ed77edf444e tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:06.177021 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5bc7811d-7e02-43c0-95b2-7ed77edf444e tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:06.177486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5bc7811d-7e02-43c0-95b2-7ed77edf444e tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:06.178421 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5bc7811d-7e02-43c0-95b2-7ed77edf444e tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:06.178890 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5bc7811d-7e02-43c0-95b2-7ed77edf444e tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:06.328742 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5bc7811d-7e02-43c0-95b2-7ed77edf444e tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:06.336505 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5bc7811d-7e02-43c0-95b2-7ed77edf444e tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1314 microversion: 2.1 time: 0.171552 Jul 28 04:01:06.350185 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 151/270] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:06 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:06.914245 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-e98b905e-1322-4cc6-9acb-68b684e5b638 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:06.915863 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-e98b905e-1322-4cc6-9acb-68b684e5b638 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:06.930805 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d829baff-fd24-4b22-aa09-fef5e40c8c84 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:06.932309 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d829baff-fd24-4b22-aa09-fef5e40c8c84 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:06.941420 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d829baff-fd24-4b22-aa09-fef5e40c8c84 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:06.942281 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e98b905e-1322-4cc6-9acb-68b684e5b638 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:06.942906 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e98b905e-1322-4cc6-9acb-68b684e5b638 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:06.944140 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e98b905e-1322-4cc6-9acb-68b684e5b638 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:06.957079 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e98b905e-1322-4cc6-9acb-68b684e5b638 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:06.960099 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d829baff-fd24-4b22-aa09-fef5e40c8c84 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:06.962842 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d829baff-fd24-4b22-aa09-fef5e40c8c84 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:06.963808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d829baff-fd24-4b22-aa09-fef5e40c8c84 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:07.325090 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-e98b905e-1322-4cc6-9acb-68b684e5b638 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:07.337262 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-e98b905e-1322-4cc6-9acb-68b684e5b638 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.427649 Jul 28 04:01:07.364628 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 120/271] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:06 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:07.377897 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-29b28e64-c6bc-4e26-b5dc-30ecb338db49 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:07.379097 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-29b28e64-c6bc-4e26-b5dc-30ecb338db49 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:07.392476 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-29b28e64-c6bc-4e26-b5dc-30ecb338db49 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:07.392950 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-29b28e64-c6bc-4e26-b5dc-30ecb338db49 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:07.393896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-29b28e64-c6bc-4e26-b5dc-30ecb338db49 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:07.396901 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-29b28e64-c6bc-4e26-b5dc-30ecb338db49 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:07.417290 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d829baff-fd24-4b22-aa09-fef5e40c8c84 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:07.432144 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d829baff-fd24-4b22-aa09-fef5e40c8c84 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1318 microversion: 2.1 time: 0.506527 Jul 28 04:01:07.433026 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 152/272] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:06 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1318 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:07.630292 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-29b28e64-c6bc-4e26-b5dc-30ecb338db49 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:07.644674 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-29b28e64-c6bc-4e26-b5dc-30ecb338db49 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1314 microversion: 2.1 time: 0.278594 Jul 28 04:01:07.645616 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 121/273] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:07 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1314 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:07.678658 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-4c6a5689-b88b-44e0-bcc5-91f1d93d3aea req-5f0939f5-52a0-45f1-b449-0b8d508c6499 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e220bf-3787-43ae-9151-849afd7d4f91", "name": "network-vif-plugged", "status": "completed", "tag": "ff3a6072-93da-4605-92c6-29a2c45cb25c"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:07.702545 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-4c6a5689-b88b-44e0-bcc5-91f1d93d3aea req-5f0939f5-52a0-45f1-b449-0b8d508c6499 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:07.705402 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-4c6a5689-b88b-44e0-bcc5-91f1d93d3aea req-5f0939f5-52a0-45f1-b449-0b8d508c6499 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:07.719819 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-4c6a5689-b88b-44e0-bcc5-91f1d93d3aea req-5f0939f5-52a0-45f1-b449-0b8d508c6499 service nova] Creating event network-vif-plugged:ff3a6072-93da-4605-92c6-29a2c45cb25c for instance 29e220bf-3787-43ae-9151-849afd7d4f91 on hv-cinder-79987 Jul 28 04:01:07.725903 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-4c6a5689-b88b-44e0-bcc5-91f1d93d3aea req-5f0939f5-52a0-45f1-b449-0b8d508c6499 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054187 Jul 28 04:01:07.727236 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 153/274] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:01:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:08.372305 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-b0120f42-dddf-4f20-b367-ffd832a295f3 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:08.373905 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-b0120f42-dddf-4f20-b367-ffd832a295f3 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:08.382258 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b0120f42-dddf-4f20-b367-ffd832a295f3 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:08.383845 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b0120f42-dddf-4f20-b367-ffd832a295f3 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:08.384738 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b0120f42-dddf-4f20-b367-ffd832a295f3 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:08.385391 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b0120f42-dddf-4f20-b367-ffd832a295f3 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:08.461908 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e770c0ce-32be-427e-9240-5405304dacff tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:08.467325 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e770c0ce-32be-427e-9240-5405304dacff tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:08.476545 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e770c0ce-32be-427e-9240-5405304dacff tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:08.477356 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e770c0ce-32be-427e-9240-5405304dacff tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:08.478406 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e770c0ce-32be-427e-9240-5405304dacff tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:08.479225 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e770c0ce-32be-427e-9240-5405304dacff tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:08.589530 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-b0120f42-dddf-4f20-b367-ffd832a295f3 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:08.599570 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-b0120f42-dddf-4f20-b367-ffd832a295f3 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.235202 Jul 28 04:01:08.600752 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 122/275] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:08 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:08.644695 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e770c0ce-32be-427e-9240-5405304dacff tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:08.648143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=100 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:08.653119 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e770c0ce-32be-427e-9240-5405304dacff tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1318 microversion: 2.1 time: 0.199955 Jul 28 04:01:08.653881 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 154/276] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:08 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:08.665812 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-1db83110-fa06-4305-bfcd-88f8cf3c6ed2 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:08.666482 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-1db83110-fa06-4305-bfcd-88f8cf3c6ed2 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:08.673610 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1db83110-fa06-4305-bfcd-88f8cf3c6ed2 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:08.674370 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1db83110-fa06-4305-bfcd-88f8cf3c6ed2 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:08.675621 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1db83110-fa06-4305-bfcd-88f8cf3c6ed2 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:08.675621 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1db83110-fa06-4305-bfcd-88f8cf3c6ed2 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:08.820043 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-1db83110-fa06-4305-bfcd-88f8cf3c6ed2 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:08.836893 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-1db83110-fa06-4305-bfcd-88f8cf3c6ed2 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1499 microversion: 2.1 time: 0.175137 Jul 28 04:01:08.837558 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 123/277] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:08 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1499 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:09.336227 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e613223e-6439-42f5-abf7-ccf18ba71e08 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:09.336725 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e613223e-6439-42f5-abf7-ccf18ba71e08 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:09.343140 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e613223e-6439-42f5-abf7-ccf18ba71e08 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:09.343593 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e613223e-6439-42f5-abf7-ccf18ba71e08 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:09.344369 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e613223e-6439-42f5-abf7-ccf18ba71e08 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:09.344808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e613223e-6439-42f5-abf7-ccf18ba71e08 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:09.371987 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e613223e-6439-42f5-abf7-ccf18ba71e08 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Going to try to terminate instance {{(pid=118187) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:01:09.467813 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e613223e-6439-42f5-abf7-ccf18ba71e08 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 204 len: 0 microversion: 2.1 time: 0.134611 Jul 28 04:01:09.468656 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 155/278] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:01:09 2022] DELETE /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:01:09.477085 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-7f9e6505-24eb-47a2-9c7d-8b76951a9fa7 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:09.477751 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-7f9e6505-24eb-47a2-9c7d-8b76951a9fa7 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:09.484566 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7f9e6505-24eb-47a2-9c7d-8b76951a9fa7 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:09.485012 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7f9e6505-24eb-47a2-9c7d-8b76951a9fa7 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:09.485924 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7f9e6505-24eb-47a2-9c7d-8b76951a9fa7 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:09.486360 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7f9e6505-24eb-47a2-9c7d-8b76951a9fa7 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:09.628460 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-767ffe22-847e-492a-967a-e1120840314e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:09.630863 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-767ffe22-847e-492a-967a-e1120840314e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:09.637559 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-7f9e6505-24eb-47a2-9c7d-8b76951a9fa7 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:09.643494 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-767ffe22-847e-492a-967a-e1120840314e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:09.644458 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-767ffe22-847e-492a-967a-e1120840314e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:09.646395 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-767ffe22-847e-492a-967a-e1120840314e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:09.647305 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-767ffe22-847e-492a-967a-e1120840314e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:09.647426 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-7f9e6505-24eb-47a2-9c7d-8b76951a9fa7 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1505 microversion: 2.1 time: 0.174328 Jul 28 04:01:09.648062 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 124/279] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:09 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1505 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:09.674203 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-d7132727-7620-4c9b-b924-723a52e82cbc tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:09.675244 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-d7132727-7620-4c9b-b924-723a52e82cbc tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:09.682432 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d7132727-7620-4c9b-b924-723a52e82cbc tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:09.682995 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d7132727-7620-4c9b-b924-723a52e82cbc tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:09.683945 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d7132727-7620-4c9b-b924-723a52e82cbc tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:09.684566 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d7132727-7620-4c9b-b924-723a52e82cbc tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:09.860362 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-d7132727-7620-4c9b-b924-723a52e82cbc tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:09.868447 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-d7132727-7620-4c9b-b924-723a52e82cbc tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1318 microversion: 2.1 time: 0.198774 Jul 28 04:01:09.869115 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 125/280] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:09 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1318 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:09.959048 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-767ffe22-847e-492a-967a-e1120840314e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:09.967449 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-767ffe22-847e-492a-967a-e1120840314e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.349254 Jul 28 04:01:09.968152 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 156/281] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:09 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:10.669945 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-1832e3ae-55f5-400f-97e7-9ca05e029651 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:10.671261 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-1832e3ae-55f5-400f-97e7-9ca05e029651 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:10.680115 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1832e3ae-55f5-400f-97e7-9ca05e029651 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:10.686344 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1832e3ae-55f5-400f-97e7-9ca05e029651 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:10.686344 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1832e3ae-55f5-400f-97e7-9ca05e029651 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:10.686344 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1832e3ae-55f5-400f-97e7-9ca05e029651 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:10.854423 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-1832e3ae-55f5-400f-97e7-9ca05e029651 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:10.863303 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-1832e3ae-55f5-400f-97e7-9ca05e029651 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1505 microversion: 2.1 time: 0.197337 Jul 28 04:01:10.867199 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 126/282] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:10 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1505 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:10.890454 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e59fade1-5589-4a63-ab47-2c2b0c701799 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:10.891329 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e59fade1-5589-4a63-ab47-2c2b0c701799 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:10.898896 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e59fade1-5589-4a63-ab47-2c2b0c701799 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:10.899534 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e59fade1-5589-4a63-ab47-2c2b0c701799 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:10.900439 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e59fade1-5589-4a63-ab47-2c2b0c701799 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:10.900887 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e59fade1-5589-4a63-ab47-2c2b0c701799 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:10.989266 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a3c2d861-b13f-46fa-bdb6-f0d6bad473d6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:10.990085 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-a3c2d861-b13f-46fa-bdb6-f0d6bad473d6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:11.000707 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a3c2d861-b13f-46fa-bdb6-f0d6bad473d6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:11.001306 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a3c2d861-b13f-46fa-bdb6-f0d6bad473d6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:11.002161 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a3c2d861-b13f-46fa-bdb6-f0d6bad473d6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:11.002702 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a3c2d861-b13f-46fa-bdb6-f0d6bad473d6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:11.044216 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e59fade1-5589-4a63-ab47-2c2b0c701799 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:11.055073 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e59fade1-5589-4a63-ab47-2c2b0c701799 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1318 microversion: 2.1 time: 0.167157 Jul 28 04:01:11.055073 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 157/283] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:10 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:11.143165 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-a3c2d861-b13f-46fa-bdb6-f0d6bad473d6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:11.151120 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-a3c2d861-b13f-46fa-bdb6-f0d6bad473d6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.165994 Jul 28 04:01:11.151696 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 127/284] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:10 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:11.885479 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-501a0587-e591-420d-945e-f06955aaf920 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:11.886373 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-501a0587-e591-420d-945e-f06955aaf920 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:11.904896 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-501a0587-e591-420d-945e-f06955aaf920 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:11.905985 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-501a0587-e591-420d-945e-f06955aaf920 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:11.905985 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-501a0587-e591-420d-945e-f06955aaf920 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:11.907287 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-501a0587-e591-420d-945e-f06955aaf920 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:12.073420 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-4a23ea81-6d38-482d-9551-e2b0ed00e75a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:12.074657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-4a23ea81-6d38-482d-9551-e2b0ed00e75a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:12.081102 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-501a0587-e591-420d-945e-f06955aaf920 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:12.085601 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4a23ea81-6d38-482d-9551-e2b0ed00e75a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:12.086062 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4a23ea81-6d38-482d-9551-e2b0ed00e75a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:12.087061 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4a23ea81-6d38-482d-9551-e2b0ed00e75a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:12.087547 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4a23ea81-6d38-482d-9551-e2b0ed00e75a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:12.092808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-501a0587-e591-420d-945e-f06955aaf920 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1505 microversion: 2.1 time: 0.211282 Jul 28 04:01:12.093524 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 158/285] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:11 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1505 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:12.172680 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9ded9bc3-24e4-4ada-a07a-dfea16a73589 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:12.173419 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9ded9bc3-24e4-4ada-a07a-dfea16a73589 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:12.179484 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9ded9bc3-24e4-4ada-a07a-dfea16a73589 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:12.180143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9ded9bc3-24e4-4ada-a07a-dfea16a73589 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:12.180922 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9ded9bc3-24e4-4ada-a07a-dfea16a73589 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:12.181373 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9ded9bc3-24e4-4ada-a07a-dfea16a73589 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:12.233722 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-4a23ea81-6d38-482d-9551-e2b0ed00e75a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:12.241820 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-4a23ea81-6d38-482d-9551-e2b0ed00e75a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1506 microversion: 2.1 time: 0.172145 Jul 28 04:01:12.242398 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 128/286] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:12 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1506 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:12.329160 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9ded9bc3-24e4-4ada-a07a-dfea16a73589 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:12.341438 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9ded9bc3-24e4-4ada-a07a-dfea16a73589 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.173001 Jul 28 04:01:12.341953 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 159/287] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:12 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:13.114084 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-da105d85-5abc-4436-a058-69230b309e8e tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:13.115442 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-da105d85-5abc-4436-a058-69230b309e8e tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:13.121811 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-da105d85-5abc-4436-a058-69230b309e8e tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:13.122462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-da105d85-5abc-4436-a058-69230b309e8e tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:13.123482 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-da105d85-5abc-4436-a058-69230b309e8e tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:13.124145 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-da105d85-5abc-4436-a058-69230b309e8e tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:13.366605 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-53137909-1fea-494d-96ac-40f06f9e0996 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:13.368267 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-53137909-1fea-494d-96ac-40f06f9e0996 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:13.376224 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-53137909-1fea-494d-96ac-40f06f9e0996 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:13.376822 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-53137909-1fea-494d-96ac-40f06f9e0996 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:13.377821 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-53137909-1fea-494d-96ac-40f06f9e0996 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:13.378992 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-53137909-1fea-494d-96ac-40f06f9e0996 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:13.429916 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-da105d85-5abc-4436-a058-69230b309e8e tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:13.438907 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-da105d85-5abc-4436-a058-69230b309e8e tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1505 microversion: 2.1 time: 0.328556 Jul 28 04:01:13.453232 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 129/288] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:13 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1505 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:13.465732 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-19aeb9ed-6082-4e00-b5a2-a1c5c4995d72 req-1032d6bb-7edf-4d1a-a559-8072b0c639f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b18d0cca-8107-4e73-aa63-0382b7c23bc4", "name": "network-vif-deleted", "tag": "d3cd7fac-141b-40c6-8d9d-79ecb5d79c9f"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:13.485087 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-19aeb9ed-6082-4e00-b5a2-a1c5c4995d72 req-1032d6bb-7edf-4d1a-a559-8072b0c639f3 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:13.486188 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-19aeb9ed-6082-4e00-b5a2-a1c5c4995d72 req-1032d6bb-7edf-4d1a-a559-8072b0c639f3 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:13.502586 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-19aeb9ed-6082-4e00-b5a2-a1c5c4995d72 req-1032d6bb-7edf-4d1a-a559-8072b0c639f3 service nova] Creating event network-vif-deleted:d3cd7fac-141b-40c6-8d9d-79ecb5d79c9f for instance b18d0cca-8107-4e73-aa63-0382b7c23bc4 on hv-cinder-79987 Jul 28 04:01:13.511917 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-19aeb9ed-6082-4e00-b5a2-a1c5c4995d72 req-1032d6bb-7edf-4d1a-a559-8072b0c639f3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056535 Jul 28 04:01:13.515982 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 130/289] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:01:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:13.583373 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-53137909-1fea-494d-96ac-40f06f9e0996 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:13.591556 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-53137909-1fea-494d-96ac-40f06f9e0996 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.231256 Jul 28 04:01:13.592443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 160/290] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:13 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:14.463773 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-1a320bce-58f1-4c55-854e-6c51f6394805 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:14.464579 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-1a320bce-58f1-4c55-854e-6c51f6394805 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:14.473060 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1a320bce-58f1-4c55-854e-6c51f6394805 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:14.473617 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1a320bce-58f1-4c55-854e-6c51f6394805 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:14.474583 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1a320bce-58f1-4c55-854e-6c51f6394805 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:14.475124 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1a320bce-58f1-4c55-854e-6c51f6394805 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:14.515886 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1a320bce-58f1-4c55-854e-6c51f6394805 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:14.516342 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1a320bce-58f1-4c55-854e-6c51f6394805 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:14.516873 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.objects.instance [None req-1a320bce-58f1-4c55-854e-6c51f6394805 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lazy-loading 'fault' on Instance uuid b18d0cca-8107-4e73-aa63-0382b7c23bc4 {{(pid=118186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:01:14.579776 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-1a320bce-58f1-4c55-854e-6c51f6394805 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:14.591418 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-1a320bce-58f1-4c55-854e-6c51f6394805 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 200 len: 1304 microversion: 2.1 time: 0.129463 Jul 28 04:01:14.591418 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 131/291] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:14 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 1304 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:14.613030 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4874a12a-29f7-4145-af10-2c87d9425783 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:14.613929 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-4874a12a-29f7-4145-af10-2c87d9425783 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:14.621037 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4874a12a-29f7-4145-af10-2c87d9425783 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:14.621592 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4874a12a-29f7-4145-af10-2c87d9425783 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:14.622601 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4874a12a-29f7-4145-af10-2c87d9425783 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:14.623190 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4874a12a-29f7-4145-af10-2c87d9425783 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:14.779320 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4874a12a-29f7-4145-af10-2c87d9425783 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:14.792814 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4874a12a-29f7-4145-af10-2c87d9425783 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.184176 Jul 28 04:01:14.794105 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 161/292] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:14 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:15.612382 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a5f31ca2-4185-4d30-8f76-9cc718a31d33 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:15.614955 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-a5f31ca2-4185-4d30-8f76-9cc718a31d33 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: b18d0cca-8107-4e73-aa63-0382b7c23bc4] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:15.621853 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a5f31ca2-4185-4d30-8f76-9cc718a31d33 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:15.622428 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a5f31ca2-4185-4d30-8f76-9cc718a31d33 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:15.623589 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a5f31ca2-4185-4d30-8f76-9cc718a31d33 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:15.624240 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a5f31ca2-4185-4d30-8f76-9cc718a31d33 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:15.642199 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.wsgi [None req-a5f31ca2-4185-4d30-8f76-9cc718a31d33 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] HTTP exception thrown: Instance b18d0cca-8107-4e73-aa63-0382b7c23bc4 could not be found. Jul 28 04:01:15.643884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a5f31ca2-4185-4d30-8f76-9cc718a31d33 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Request method failure captured: Jul 28 04:01:15.643884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: request: GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 HTTP/1.1 Jul 28 04:01:15.643884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept: application/json Jul 28 04:01:15.643884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept-Encoding: identity Jul 28 04:01:15.643884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Connection: close Jul 28 04:01:15.643884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Length: 0 Jul 28 04:01:15.643884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Type: application/json Jul 28 04:01:15.643884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Host: 10.222.0.46 Jul 28 04:01:15.643884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Openstack-System-Scope: None Jul 28 04:01:15.643884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: User-Agent: python-urllib3/1.26.10 Jul 28 04:01:15.643884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Auth-Token: gAAAAABi4gnf4EsI6Q1n2ntTSkUCiStU610XIsT3_AFabfDUDH1LfWlD_pSVmVAxn7_I3J-fwyNBtSBVyoFug3arLC5FNcZPQfr7eyowKGHK1x1k-DsyRwtMb-i9_PmADj_wuXwzga5GIsJkCSZYCK_6LWp-beTDx-g9mACP6zAfDBdCVisnCnA Jul 28 04:01:15.643884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Id: None Jul 28 04:01:15.643884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Name: None Jul 28 04:01:15.643884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Identity-Status: Confirmed Jul 28 04:01:15.643884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Is-Admin-Project: True Jul 28 04:01:15.643884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Id: default Jul 28 04:01:15.643884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Name: Default Jul 28 04:01:15.643884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Id: 9ed8ce4c8a3442deacf65acc0c05dad3 Jul 28 04:01:15.643884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Name: tempest-VolumesActionsTest-1602868677 Jul 28 04:01:15.643884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Role: reader,member Jul 28 04:01:15.643884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Roles: reader,member Jul 28 04:01:15.645234 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9ed8ce4c8a3442deacf65acc0c05dad3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9ed8ce4c8a3442deacf65acc0c05dad3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9ed8ce4c8a3442deacf65acc0c05dad3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9ed8ce4c8a3442deacf65acc0c05dad3"}]}] Jul 28 04:01:15.645234 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant: tempest-VolumesActionsTest-1602868677 Jul 28 04:01:15.645234 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Id: 9ed8ce4c8a3442deacf65acc0c05dad3 Jul 28 04:01:15.645234 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Name: tempest-VolumesActionsTest-1602868677 Jul 28 04:01:15.645234 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User: tempest-VolumesActionsTest-1602868677-project Jul 28 04:01:15.645234 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Id: default Jul 28 04:01:15.645234 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Name: Default Jul 28 04:01:15.645234 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Id: 820e385c27af49f08301be61fcde369b Jul 28 04:01:15.645234 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Name: tempest-VolumesActionsTest-1602868677-project Jul 28 04:01:15.645234 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: method: > Jul 28 04:01:15.645234 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: exception: Instance b18d0cca-8107-4e73-aa63-0382b7c23bc4 could not be found. Jul 28 04:01:15.645234 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: action_args: {'id': 'b18d0cca-8107-4e73-aa63-0382b7c23bc4'} Jul 28 04:01:15.646117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:01:15.646117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:01:15.646117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:01:15.646117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:01:15.646117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:01:15.646117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:01:15.646117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:01:15.646117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:01:15.646117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:01:15.646117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:01:15.646117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b18d0cca-8107-4e73-aa63-0382b7c23bc4 could not be found. Jul 28 04:01:15.646117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:01:15.646117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:01:15.646117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:01:15.646117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:01:15.646117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:01:15.646117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:01:15.646117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:01:15.646117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:01:15.646117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:01:15.647576 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:01:15.647576 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:01:15.647576 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:01:15.647576 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:01:15.647576 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:01:15.647576 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:01:15.647576 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:01:15.647576 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b18d0cca-8107-4e73-aa63-0382b7c23bc4 could not be found. Jul 28 04:01:15.647576 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:01:15.647576 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:01:15.647576 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:01:15.647576 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:01:15.647576 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:01:15.647576 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:01:15.647576 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:01:15.647576 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:01:15.647576 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b18d0cca-8107-4e73-aa63-0382b7c23bc4 could not be found. Jul 28 04:01:15.647576 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:01:15.650376 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a5f31ca2-4185-4d30-8f76-9cc718a31d33 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Returning 404 to user: Instance b18d0cca-8107-4e73-aa63-0382b7c23bc4 could not be found. {{(pid=118186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:01:15.650376 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-a5f31ca2-4185-4d30-8f76-9cc718a31d33 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4" status: 404 len: 111 microversion: 2.1 time: 0.038552 Jul 28 04:01:15.660091 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 132/293] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:15 2022] GET /compute/v2.1/servers/b18d0cca-8107-4e73-aa63-0382b7c23bc4 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:01:15.766125 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-71393ce1-123a-461e-9c21-c8c69b4291cf tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-974876859", "imageRef": "a0eec51c-83e9-420b-bcb9-20fe8dcf5321", "flavorRef": "452", "networks": [{"uuid": "00066c96-9353-459f-8282-fe1e0505aebc"}]}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:15.819165 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-b1318046-c987-4760-a1db-c3ca008662d4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:15.819793 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-b1318046-c987-4760-a1db-c3ca008662d4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:15.833439 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.network.neutron [None req-71393ce1-123a-461e-9c21-c8c69b4291cf tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] validate_networks() for [('00066c96-9353-459f-8282-fe1e0505aebc', None, None, None, None, None)] {{(pid=118187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:01:15.838908 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b1318046-c987-4760-a1db-c3ca008662d4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:15.841067 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b1318046-c987-4760-a1db-c3ca008662d4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:15.842173 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b1318046-c987-4760-a1db-c3ca008662d4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:15.843507 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b1318046-c987-4760-a1db-c3ca008662d4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:16.062230 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-b1318046-c987-4760-a1db-c3ca008662d4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:16.070479 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-b1318046-c987-4760-a1db-c3ca008662d4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.255719 Jul 28 04:01:16.073364 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 133/294] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:15 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:16.278627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-71393ce1-123a-461e-9c21-c8c69b4291cf tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Flavor limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:01:16.280271 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-71393ce1-123a-461e-9c21-c8c69b4291cf tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Image limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:01:16.281003 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-71393ce1-123a-461e-9c21-c8c69b4291cf tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Flavor pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:01:16.281810 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-71393ce1-123a-461e-9c21-c8c69b4291cf tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Image pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:01:16.282228 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-71393ce1-123a-461e-9c21-c8c69b4291cf tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:01:16.291884 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-71393ce1-123a-461e-9c21-c8c69b4291cf tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:16.292363 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-71393ce1-123a-461e-9c21-c8c69b4291cf tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:16.293171 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-71393ce1-123a-461e-9c21-c8c69b4291cf tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:16.293608 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-71393ce1-123a-461e-9c21-c8c69b4291cf tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:16.318673 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-71393ce1-123a-461e-9c21-c8c69b4291cf tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Getting quotas for project 9ed8ce4c8a3442deacf65acc0c05dad3. Resources: {'instances', 'cores', 'ram'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:01:16.324612 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-71393ce1-123a-461e-9c21-c8c69b4291cf tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Getting quotas for user 820e385c27af49f08301be61fcde369b and project 9ed8ce4c8a3442deacf65acc0c05dad3. Resources: {'instances', 'cores', 'ram'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:01:16.339460 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-71393ce1-123a-461e-9c21-c8c69b4291cf tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Going to run 1 instances... {{(pid=118187) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:01:16.342006 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-71393ce1-123a-461e-9c21-c8c69b4291cf tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: 8adf9bc4-4136-466f-ab32-4711d9fa9ced] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0eec51c-83e9-420b-bcb9-20fe8dcf5321',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:01:16.398427 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-71393ce1-123a-461e-9c21-c8c69b4291cf tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.636674 Jul 28 04:01:16.399705 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 162/295] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 04:01:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:01:16.411155 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-8b977c82-bbb7-42a8-8b6a-5efaf924e341 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:16.411897 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-8b977c82-bbb7-42a8-8b6a-5efaf924e341 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: 8adf9bc4-4136-466f-ab32-4711d9fa9ced] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:16.491147 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-8b977c82-bbb7-42a8-8b6a-5efaf924e341 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:16.501172 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-8b977c82-bbb7-42a8-8b6a-5efaf924e341 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced" status: 200 len: 1213 microversion: 2.1 time: 0.094580 Jul 28 04:01:16.515842 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 134/296] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:16 2022] GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced => generated 1213 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:17.097528 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f087a2dd-0e40-475d-b7b0-47c40411f35f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:17.098146 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f087a2dd-0e40-475d-b7b0-47c40411f35f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:17.104424 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f087a2dd-0e40-475d-b7b0-47c40411f35f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:17.105414 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f087a2dd-0e40-475d-b7b0-47c40411f35f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:17.106635 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f087a2dd-0e40-475d-b7b0-47c40411f35f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:17.107038 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f087a2dd-0e40-475d-b7b0-47c40411f35f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:17.269910 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f087a2dd-0e40-475d-b7b0-47c40411f35f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:17.278476 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f087a2dd-0e40-475d-b7b0-47c40411f35f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1521 microversion: 2.1 time: 0.186347 Jul 28 04:01:17.280562 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 163/297] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:17 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:17.524231 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-4e96b3e0-a799-4a96-b65e-ad6706952691 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:17.524854 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-4e96b3e0-a799-4a96-b65e-ad6706952691 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: 8adf9bc4-4136-466f-ab32-4711d9fa9ced] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:17.542200 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4e96b3e0-a799-4a96-b65e-ad6706952691 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:17.542735 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4e96b3e0-a799-4a96-b65e-ad6706952691 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:17.543634 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4e96b3e0-a799-4a96-b65e-ad6706952691 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:17.544171 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4e96b3e0-a799-4a96-b65e-ad6706952691 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:17.612956 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-4e96b3e0-a799-4a96-b65e-ad6706952691 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:17.620859 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-4e96b3e0-a799-4a96-b65e-ad6706952691 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced" status: 200 len: 1265 microversion: 2.1 time: 0.101550 Jul 28 04:01:17.621448 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 135/298] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:17 2022] GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced => generated 1265 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:18.304512 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-311bd007-61dc-4ff3-b87b-968717b045aa tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:18.305371 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-311bd007-61dc-4ff3-b87b-968717b045aa tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:18.323194 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-311bd007-61dc-4ff3-b87b-968717b045aa tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:18.324819 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-311bd007-61dc-4ff3-b87b-968717b045aa tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:18.325656 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-311bd007-61dc-4ff3-b87b-968717b045aa tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:18.327352 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-311bd007-61dc-4ff3-b87b-968717b045aa tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:18.523295 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-311bd007-61dc-4ff3-b87b-968717b045aa tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:18.544464 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-311bd007-61dc-4ff3-b87b-968717b045aa tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1501 microversion: 2.1 time: 0.244956 Jul 28 04:01:18.545278 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 164/299] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:18 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1501 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:18.566494 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-94e64836-be0c-47b8-9654-dac50be3f49c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:18.567758 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-94e64836-be0c-47b8-9654-dac50be3f49c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:18.574840 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-94e64836-be0c-47b8-9654-dac50be3f49c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:18.575330 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-94e64836-be0c-47b8-9654-dac50be3f49c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:18.576294 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-94e64836-be0c-47b8-9654-dac50be3f49c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:18.576954 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-94e64836-be0c-47b8-9654-dac50be3f49c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:18.644142 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5f01de47-ce8c-470a-b117-eaa657320b15 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:18.644779 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5f01de47-ce8c-470a-b117-eaa657320b15 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: 8adf9bc4-4136-466f-ab32-4711d9fa9ced] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:18.650984 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f01de47-ce8c-470a-b117-eaa657320b15 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:18.651429 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f01de47-ce8c-470a-b117-eaa657320b15 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:18.652511 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f01de47-ce8c-470a-b117-eaa657320b15 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:18.652957 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f01de47-ce8c-470a-b117-eaa657320b15 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:18.721753 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5f01de47-ce8c-470a-b117-eaa657320b15 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:18.729635 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5f01de47-ce8c-470a-b117-eaa657320b15 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced" status: 200 len: 1271 microversion: 2.1 time: 0.090461 Jul 28 04:01:18.730202 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 165/300] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:18 2022] GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced => generated 1271 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:18.775949 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-94e64836-be0c-47b8-9654-dac50be3f49c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:18.788352 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-94e64836-be0c-47b8-9654-dac50be3f49c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1516 microversion: 2.1 time: 0.225770 Jul 28 04:01:18.789192 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 136/301] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:18 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1516 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:19.567734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-954fea1d-0d89-43ce-b7c9-c0a8282c3d4d req-98d4d7f8-2537-4a41-be23-6aed8896f9bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8adf9bc4-4136-466f-ab32-4711d9fa9ced", "tag": "2973ff5a-fad6-4b3a-8698-ccf19f56a7a8"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:19.598965 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-954fea1d-0d89-43ce-b7c9-c0a8282c3d4d req-98d4d7f8-2537-4a41-be23-6aed8896f9bf service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:19.599519 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-954fea1d-0d89-43ce-b7c9-c0a8282c3d4d req-98d4d7f8-2537-4a41-be23-6aed8896f9bf service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:19.611990 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-954fea1d-0d89-43ce-b7c9-c0a8282c3d4d req-98d4d7f8-2537-4a41-be23-6aed8896f9bf service nova] Creating event network-changed:2973ff5a-fad6-4b3a-8698-ccf19f56a7a8 for instance 8adf9bc4-4136-466f-ab32-4711d9fa9ced on hv-cinder-79987 Jul 28 04:01:19.628501 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-954fea1d-0d89-43ce-b7c9-c0a8282c3d4d req-98d4d7f8-2537-4a41-be23-6aed8896f9bf service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.063699 Jul 28 04:01:19.629401 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 166/302] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:19.752890 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-97926238-5ae2-48bd-af09-7c81b6ff282a tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:19.753504 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-97926238-5ae2-48bd-af09-7c81b6ff282a tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: 8adf9bc4-4136-466f-ab32-4711d9fa9ced] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:19.760129 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-97926238-5ae2-48bd-af09-7c81b6ff282a tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:19.760571 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-97926238-5ae2-48bd-af09-7c81b6ff282a tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:19.761326 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-97926238-5ae2-48bd-af09-7c81b6ff282a tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:19.761752 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-97926238-5ae2-48bd-af09-7c81b6ff282a tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:19.990467 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-97926238-5ae2-48bd-af09-7c81b6ff282a tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:19.992785 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=100 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:19.999280 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-97926238-5ae2-48bd-af09-7c81b6ff282a tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced" status: 200 len: 1313 microversion: 2.1 time: 0.251173 Jul 28 04:01:19.999846 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 137/303] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:19 2022] GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced => generated 1313 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:20.246556 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-034c1bf5-4242-4dd8-81fb-a4918822bf9c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:20.249016 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-034c1bf5-4242-4dd8-81fb-a4918822bf9c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:20.256963 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-034c1bf5-4242-4dd8-81fb-a4918822bf9c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:20.257411 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-034c1bf5-4242-4dd8-81fb-a4918822bf9c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:20.258176 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-034c1bf5-4242-4dd8-81fb-a4918822bf9c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:20.258609 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-034c1bf5-4242-4dd8-81fb-a4918822bf9c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:20.285354 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.objects.instance [None req-034c1bf5-4242-4dd8-81fb-a4918822bf9c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lazy-loading 'flavor' on Instance uuid 54fdcaaa-031e-4509-b8a7-6b284460c7d2 {{(pid=118187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:01:20.369291 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-034c1bf5-4242-4dd8-81fb-a4918822bf9c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "POST /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2/action" status: 200 len: 32 microversion: 2.1 time: 0.126089 Jul 28 04:01:20.370747 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 167/304] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Jul 28 04:01:20 2022] POST /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2/action => generated 32 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:01:20.380909 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-310fe803-2bf2-44cd-8fd4-0fc114c79281 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:20.381620 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-310fe803-2bf2-44cd-8fd4-0fc114c79281 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:20.388655 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-310fe803-2bf2-44cd-8fd4-0fc114c79281 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:20.389888 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-310fe803-2bf2-44cd-8fd4-0fc114c79281 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:20.390882 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-310fe803-2bf2-44cd-8fd4-0fc114c79281 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:20.391327 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-310fe803-2bf2-44cd-8fd4-0fc114c79281 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:20.711744 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-310fe803-2bf2-44cd-8fd4-0fc114c79281 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:20.721970 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-310fe803-2bf2-44cd-8fd4-0fc114c79281 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.345281 Jul 28 04:01:20.722549 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 138/305] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:20 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:21.020975 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e94dd861-e8f5-42ce-8f14-383ba0b67948 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:21.021677 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e94dd861-e8f5-42ce-8f14-383ba0b67948 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: 8adf9bc4-4136-466f-ab32-4711d9fa9ced] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:21.028042 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e94dd861-e8f5-42ce-8f14-383ba0b67948 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:21.028496 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e94dd861-e8f5-42ce-8f14-383ba0b67948 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:21.029256 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e94dd861-e8f5-42ce-8f14-383ba0b67948 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:21.030405 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e94dd861-e8f5-42ce-8f14-383ba0b67948 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:21.170443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e94dd861-e8f5-42ce-8f14-383ba0b67948 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:21.177969 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e94dd861-e8f5-42ce-8f14-383ba0b67948 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced" status: 200 len: 1313 microversion: 2.1 time: 0.161346 Jul 28 04:01:21.178544 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 168/306] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:21 2022] GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:21.745978 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-5eb10506-a9d8-4b83-953e-92a514ba149c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:21.746671 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-5eb10506-a9d8-4b83-953e-92a514ba149c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:21.753541 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5eb10506-a9d8-4b83-953e-92a514ba149c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:21.754183 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5eb10506-a9d8-4b83-953e-92a514ba149c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:21.755074 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5eb10506-a9d8-4b83-953e-92a514ba149c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:21.755515 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5eb10506-a9d8-4b83-953e-92a514ba149c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:21.893836 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-5eb10506-a9d8-4b83-953e-92a514ba149c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:21.901498 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-5eb10506-a9d8-4b83-953e-92a514ba149c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.159898 Jul 28 04:01:21.902056 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 139/307] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:21 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:22.199261 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-66f7ba22-24d8-440a-a8d1-9fc5db36f02b tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:22.199906 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-66f7ba22-24d8-440a-a8d1-9fc5db36f02b tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: 8adf9bc4-4136-466f-ab32-4711d9fa9ced] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:22.206324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-66f7ba22-24d8-440a-a8d1-9fc5db36f02b tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:22.206845 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-66f7ba22-24d8-440a-a8d1-9fc5db36f02b tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:22.207733 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-66f7ba22-24d8-440a-a8d1-9fc5db36f02b tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:22.208169 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-66f7ba22-24d8-440a-a8d1-9fc5db36f02b tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:22.213553 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:22.349102 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-66f7ba22-24d8-440a-a8d1-9fc5db36f02b tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:22.356781 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-66f7ba22-24d8-440a-a8d1-9fc5db36f02b tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced" status: 200 len: 1313 microversion: 2.1 time: 0.161389 Jul 28 04:01:22.357336 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 169/308] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:22 2022] GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:22.925558 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-88687ffb-346e-4228-b8aa-4008e66d29a5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:22.926182 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-88687ffb-346e-4228-b8aa-4008e66d29a5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:22.932833 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-88687ffb-346e-4228-b8aa-4008e66d29a5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:22.933290 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-88687ffb-346e-4228-b8aa-4008e66d29a5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:22.934058 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-88687ffb-346e-4228-b8aa-4008e66d29a5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:22.934495 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-88687ffb-346e-4228-b8aa-4008e66d29a5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:23.062951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-88687ffb-346e-4228-b8aa-4008e66d29a5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:23.070425 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-88687ffb-346e-4228-b8aa-4008e66d29a5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.148849 Jul 28 04:01:23.071024 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 140/309] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:22 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:23.380741 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ce643651-a775-4d4d-bab5-1c7719eea159 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:23.381288 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ce643651-a775-4d4d-bab5-1c7719eea159 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: 8adf9bc4-4136-466f-ab32-4711d9fa9ced] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:23.388014 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ce643651-a775-4d4d-bab5-1c7719eea159 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:23.388463 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ce643651-a775-4d4d-bab5-1c7719eea159 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:23.389864 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ce643651-a775-4d4d-bab5-1c7719eea159 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:23.390606 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ce643651-a775-4d4d-bab5-1c7719eea159 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:23.530377 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ce643651-a775-4d4d-bab5-1c7719eea159 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:23.540845 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ce643651-a775-4d4d-bab5-1c7719eea159 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced" status: 200 len: 1313 microversion: 2.1 time: 0.165020 Jul 28 04:01:23.541426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 170/310] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:23 2022] GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:24.092440 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-d756e961-3748-4772-b173-dd5682551661 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:24.093060 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-d756e961-3748-4772-b173-dd5682551661 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:24.100317 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d756e961-3748-4772-b173-dd5682551661 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:24.100773 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d756e961-3748-4772-b173-dd5682551661 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:24.101552 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d756e961-3748-4772-b173-dd5682551661 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:24.101986 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d756e961-3748-4772-b173-dd5682551661 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:24.246149 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-d756e961-3748-4772-b173-dd5682551661 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:24.254458 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-d756e961-3748-4772-b173-dd5682551661 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.166431 Jul 28 04:01:24.255044 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 141/311] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:24 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:24.562885 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9f71b66c-97ae-4328-b8f2-0f24df28981d tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:24.563815 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9f71b66c-97ae-4328-b8f2-0f24df28981d tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: 8adf9bc4-4136-466f-ab32-4711d9fa9ced] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:24.569822 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9f71b66c-97ae-4328-b8f2-0f24df28981d tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:24.570267 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9f71b66c-97ae-4328-b8f2-0f24df28981d tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:24.571048 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9f71b66c-97ae-4328-b8f2-0f24df28981d tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:24.571482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9f71b66c-97ae-4328-b8f2-0f24df28981d tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:24.701428 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9f71b66c-97ae-4328-b8f2-0f24df28981d tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:24.709043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9f71b66c-97ae-4328-b8f2-0f24df28981d tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced" status: 200 len: 1313 microversion: 2.1 time: 0.151198 Jul 28 04:01:24.709622 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 171/312] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:24 2022] GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:25.275176 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c71cafe0-ef6c-40f2-b58e-20f91c4c0b86 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:25.275699 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c71cafe0-ef6c-40f2-b58e-20f91c4c0b86 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:25.282735 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c71cafe0-ef6c-40f2-b58e-20f91c4c0b86 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:25.283308 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c71cafe0-ef6c-40f2-b58e-20f91c4c0b86 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:25.284104 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c71cafe0-ef6c-40f2-b58e-20f91c4c0b86 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:25.284551 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c71cafe0-ef6c-40f2-b58e-20f91c4c0b86 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:25.423532 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-c71cafe0-ef6c-40f2-b58e-20f91c4c0b86 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:25.431199 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-c71cafe0-ef6c-40f2-b58e-20f91c4c0b86 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.160079 Jul 28 04:01:25.431778 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 142/313] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:25 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:25.729362 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ecdce9b8-24e6-4685-96ad-4b3c3bc238e9 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:25.729981 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ecdce9b8-24e6-4685-96ad-4b3c3bc238e9 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: 8adf9bc4-4136-466f-ab32-4711d9fa9ced] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:25.736558 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ecdce9b8-24e6-4685-96ad-4b3c3bc238e9 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:25.737005 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ecdce9b8-24e6-4685-96ad-4b3c3bc238e9 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:25.737763 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ecdce9b8-24e6-4685-96ad-4b3c3bc238e9 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:25.738200 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ecdce9b8-24e6-4685-96ad-4b3c3bc238e9 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:25.874718 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ecdce9b8-24e6-4685-96ad-4b3c3bc238e9 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:25.882991 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ecdce9b8-24e6-4685-96ad-4b3c3bc238e9 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced" status: 200 len: 1313 microversion: 2.1 time: 0.157461 Jul 28 04:01:25.883556 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 172/314] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:25 2022] GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:26.452504 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-120c85f4-5360-4a1b-9af9-d5e1ac2e9436 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:26.453644 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-120c85f4-5360-4a1b-9af9-d5e1ac2e9436 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:26.460668 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-120c85f4-5360-4a1b-9af9-d5e1ac2e9436 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:26.461120 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-120c85f4-5360-4a1b-9af9-d5e1ac2e9436 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:26.461877 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-120c85f4-5360-4a1b-9af9-d5e1ac2e9436 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:26.462312 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-120c85f4-5360-4a1b-9af9-d5e1ac2e9436 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:26.495393 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell0:SELECT=2 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:26.599152 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-120c85f4-5360-4a1b-9af9-d5e1ac2e9436 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:26.606630 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-120c85f4-5360-4a1b-9af9-d5e1ac2e9436 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.158065 Jul 28 04:01:26.607232 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 143/315] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:26 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:26.904352 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-cfe954d7-629d-49db-a0cd-5ad01cf25719 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:26.904968 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-cfe954d7-629d-49db-a0cd-5ad01cf25719 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: 8adf9bc4-4136-466f-ab32-4711d9fa9ced] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:26.906839 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:26.908124 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=6 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:26.914618 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cfe954d7-629d-49db-a0cd-5ad01cf25719 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:26.915087 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cfe954d7-629d-49db-a0cd-5ad01cf25719 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:26.915874 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cfe954d7-629d-49db-a0cd-5ad01cf25719 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:26.916309 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cfe954d7-629d-49db-a0cd-5ad01cf25719 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:27.054590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-cfe954d7-629d-49db-a0cd-5ad01cf25719 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:27.062328 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-cfe954d7-629d-49db-a0cd-5ad01cf25719 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced" status: 200 len: 1313 microversion: 2.1 time: 0.161601 Jul 28 04:01:27.062687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 173/316] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:26 2022] GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:27.628935 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-74d25f26-4432-4c56-b838-4b7853aa0abc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:27.629476 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-74d25f26-4432-4c56-b838-4b7853aa0abc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:27.635516 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-74d25f26-4432-4c56-b838-4b7853aa0abc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:27.635962 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-74d25f26-4432-4c56-b838-4b7853aa0abc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:27.636720 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-74d25f26-4432-4c56-b838-4b7853aa0abc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:27.637180 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-74d25f26-4432-4c56-b838-4b7853aa0abc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:27.773992 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-74d25f26-4432-4c56-b838-4b7853aa0abc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:27.803190 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-74d25f26-4432-4c56-b838-4b7853aa0abc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.178782 Jul 28 04:01:27.806364 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 144/317] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:27 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:28.095411 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-36525d84-6bb2-4168-9791-2815a7f2d188 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:28.096924 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-36525d84-6bb2-4168-9791-2815a7f2d188 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: 8adf9bc4-4136-466f-ab32-4711d9fa9ced] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:28.105481 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-36525d84-6bb2-4168-9791-2815a7f2d188 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:28.106500 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-36525d84-6bb2-4168-9791-2815a7f2d188 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:28.107398 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-36525d84-6bb2-4168-9791-2815a7f2d188 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:28.107852 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-36525d84-6bb2-4168-9791-2815a7f2d188 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:28.265579 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-36525d84-6bb2-4168-9791-2815a7f2d188 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:28.273878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-36525d84-6bb2-4168-9791-2815a7f2d188 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced" status: 200 len: 1313 microversion: 2.1 time: 0.188783 Jul 28 04:01:28.274900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 174/318] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:28 2022] GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:28.832370 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-74d894dd-521b-45c9-b5ed-806406dd9522 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:28.832974 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-74d894dd-521b-45c9-b5ed-806406dd9522 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:28.839764 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-74d894dd-521b-45c9-b5ed-806406dd9522 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:28.840207 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-74d894dd-521b-45c9-b5ed-806406dd9522 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:28.840954 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-74d894dd-521b-45c9-b5ed-806406dd9522 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:28.841384 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-74d894dd-521b-45c9-b5ed-806406dd9522 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:28.976851 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-74d894dd-521b-45c9-b5ed-806406dd9522 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:28.986075 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-74d894dd-521b-45c9-b5ed-806406dd9522 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.157796 Jul 28 04:01:28.987646 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 145/319] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:28 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:29.296027 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-80dc20f3-0f5a-4417-b646-5d26b352ea3b tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:29.296709 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-80dc20f3-0f5a-4417-b646-5d26b352ea3b tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: 8adf9bc4-4136-466f-ab32-4711d9fa9ced] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:29.299305 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:29.305297 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-80dc20f3-0f5a-4417-b646-5d26b352ea3b tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:29.305770 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-80dc20f3-0f5a-4417-b646-5d26b352ea3b tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:29.306623 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-80dc20f3-0f5a-4417-b646-5d26b352ea3b tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:29.307106 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-80dc20f3-0f5a-4417-b646-5d26b352ea3b tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:29.465520 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-80dc20f3-0f5a-4417-b646-5d26b352ea3b tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:29.473876 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-80dc20f3-0f5a-4417-b646-5d26b352ea3b tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced" status: 200 len: 1313 microversion: 2.1 time: 0.181724 Jul 28 04:01:29.474627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 175/320] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:29 2022] GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced => generated 1313 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:29.500738 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-317ec9e1-a727-4ad0-aeb9-733805315ff4 req-796de3b8-2747-42a7-b68b-cba99df3f86f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8adf9bc4-4136-466f-ab32-4711d9fa9ced", "name": "network-vif-plugged", "status": "completed", "tag": "2973ff5a-fad6-4b3a-8698-ccf19f56a7a8"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:29.511564 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-317ec9e1-a727-4ad0-aeb9-733805315ff4 req-796de3b8-2747-42a7-b68b-cba99df3f86f service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:29.512032 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-317ec9e1-a727-4ad0-aeb9-733805315ff4 req-796de3b8-2747-42a7-b68b-cba99df3f86f service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:29.525567 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-317ec9e1-a727-4ad0-aeb9-733805315ff4 req-796de3b8-2747-42a7-b68b-cba99df3f86f service nova] Creating event network-vif-plugged:2973ff5a-fad6-4b3a-8698-ccf19f56a7a8 for instance 8adf9bc4-4136-466f-ab32-4711d9fa9ced on hv-cinder-79987 Jul 28 04:01:29.531708 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-317ec9e1-a727-4ad0-aeb9-733805315ff4 req-796de3b8-2747-42a7-b68b-cba99df3f86f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034483 Jul 28 04:01:29.534304 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 146/321] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:30.008138 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e8517696-caa3-4ee2-9edb-7d95a44aff94 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:30.008744 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e8517696-caa3-4ee2-9edb-7d95a44aff94 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:30.014699 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e8517696-caa3-4ee2-9edb-7d95a44aff94 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:30.015176 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e8517696-caa3-4ee2-9edb-7d95a44aff94 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:30.015931 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e8517696-caa3-4ee2-9edb-7d95a44aff94 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:30.016364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e8517696-caa3-4ee2-9edb-7d95a44aff94 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:30.155820 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e8517696-caa3-4ee2-9edb-7d95a44aff94 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:30.164668 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e8517696-caa3-4ee2-9edb-7d95a44aff94 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.160331 Jul 28 04:01:30.165238 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 176/322] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:30 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:30.495859 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-730a6b12-e3aa-4f78-8e5d-19ebec177c51 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:30.496595 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-730a6b12-e3aa-4f78-8e5d-19ebec177c51 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: 8adf9bc4-4136-466f-ab32-4711d9fa9ced] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:30.504275 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-730a6b12-e3aa-4f78-8e5d-19ebec177c51 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:30.504721 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-730a6b12-e3aa-4f78-8e5d-19ebec177c51 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:30.505506 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-730a6b12-e3aa-4f78-8e5d-19ebec177c51 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:30.505934 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-730a6b12-e3aa-4f78-8e5d-19ebec177c51 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:30.638685 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-730a6b12-e3aa-4f78-8e5d-19ebec177c51 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:30.646931 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-730a6b12-e3aa-4f78-8e5d-19ebec177c51 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced" status: 200 len: 1313 microversion: 2.1 time: 0.155378 Jul 28 04:01:30.647496 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 147/323] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:30 2022] GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:31.187153 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-40ddfb32-6abc-4c23-bfed-5a063f518e2e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:31.187677 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-40ddfb32-6abc-4c23-bfed-5a063f518e2e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:31.194885 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-40ddfb32-6abc-4c23-bfed-5a063f518e2e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:31.195347 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-40ddfb32-6abc-4c23-bfed-5a063f518e2e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:31.196211 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-40ddfb32-6abc-4c23-bfed-5a063f518e2e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:31.196659 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-40ddfb32-6abc-4c23-bfed-5a063f518e2e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:31.335814 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-40ddfb32-6abc-4c23-bfed-5a063f518e2e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:31.343210 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-40ddfb32-6abc-4c23-bfed-5a063f518e2e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.160033 Jul 28 04:01:31.343777 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 177/324] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:31 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:31.668023 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-08345fdf-acd6-4080-b269-57d56f6c0f32 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:31.668675 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-08345fdf-acd6-4080-b269-57d56f6c0f32 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: 8adf9bc4-4136-466f-ab32-4711d9fa9ced] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:31.675723 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-08345fdf-acd6-4080-b269-57d56f6c0f32 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:31.676186 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-08345fdf-acd6-4080-b269-57d56f6c0f32 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:31.676949 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-08345fdf-acd6-4080-b269-57d56f6c0f32 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:31.677388 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-08345fdf-acd6-4080-b269-57d56f6c0f32 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:31.807153 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-08345fdf-acd6-4080-b269-57d56f6c0f32 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:31.815293 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-08345fdf-acd6-4080-b269-57d56f6c0f32 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced" status: 200 len: 1313 microversion: 2.1 time: 0.151128 Jul 28 04:01:31.815861 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 148/325] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:31 2022] GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:32.046324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a25f5b3f-c142-4888-b036-a63d44080e65 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:32.046857 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a25f5b3f-c142-4888-b036-a63d44080e65 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:32.053515 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a25f5b3f-c142-4888-b036-a63d44080e65 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:32.053942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a25f5b3f-c142-4888-b036-a63d44080e65 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:32.054772 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a25f5b3f-c142-4888-b036-a63d44080e65 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:32.055314 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a25f5b3f-c142-4888-b036-a63d44080e65 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:32.083309 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a25f5b3f-c142-4888-b036-a63d44080e65 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475/ips" status: 200 len: 146 microversion: 2.1 time: 0.040640 Jul 28 04:01:32.083966 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 178/326] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Jul 28 04:01:32 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:32.364504 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-1c634339-9538-49cd-a823-1e0da5cf7055 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:32.365045 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-1c634339-9538-49cd-a823-1e0da5cf7055 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:32.371543 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1c634339-9538-49cd-a823-1e0da5cf7055 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:32.371990 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1c634339-9538-49cd-a823-1e0da5cf7055 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:32.372763 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1c634339-9538-49cd-a823-1e0da5cf7055 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:32.373269 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1c634339-9538-49cd-a823-1e0da5cf7055 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:32.508092 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-1c634339-9538-49cd-a823-1e0da5cf7055 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:32.515702 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-1c634339-9538-49cd-a823-1e0da5cf7055 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.155779 Jul 28 04:01:32.516261 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 149/327] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:32 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:32.835871 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-02ab509d-01d5-4dcd-aaab-05c182529f42 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:32.836492 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-02ab509d-01d5-4dcd-aaab-05c182529f42 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: 8adf9bc4-4136-466f-ab32-4711d9fa9ced] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:32.842577 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-02ab509d-01d5-4dcd-aaab-05c182529f42 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:32.843066 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-02ab509d-01d5-4dcd-aaab-05c182529f42 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:32.843828 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-02ab509d-01d5-4dcd-aaab-05c182529f42 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:32.844268 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-02ab509d-01d5-4dcd-aaab-05c182529f42 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:32.973832 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-02ab509d-01d5-4dcd-aaab-05c182529f42 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:32.981315 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-02ab509d-01d5-4dcd-aaab-05c182529f42 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced" status: 200 len: 1313 microversion: 2.1 time: 0.149365 Jul 28 04:01:32.981878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 179/328] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:32 2022] GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:33.538261 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-44c710de-9add-400f-ac8a-efae8d6489df tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:33.538899 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-44c710de-9add-400f-ac8a-efae8d6489df tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:33.541316 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=76 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:33.546525 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-44c710de-9add-400f-ac8a-efae8d6489df tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:33.547017 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-44c710de-9add-400f-ac8a-efae8d6489df tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:33.548365 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-44c710de-9add-400f-ac8a-efae8d6489df tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:33.548804 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-44c710de-9add-400f-ac8a-efae8d6489df tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:33.683570 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-44c710de-9add-400f-ac8a-efae8d6489df tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:33.691155 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-44c710de-9add-400f-ac8a-efae8d6489df tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.157211 Jul 28 04:01:33.691731 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 150/329] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:33 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:34.003144 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d817b14a-8047-4f28-a207-7743340b3149 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:34.003678 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d817b14a-8047-4f28-a207-7743340b3149 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: 8adf9bc4-4136-466f-ab32-4711d9fa9ced] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:34.009667 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d817b14a-8047-4f28-a207-7743340b3149 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:34.010184 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d817b14a-8047-4f28-a207-7743340b3149 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:34.010969 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d817b14a-8047-4f28-a207-7743340b3149 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:34.011407 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d817b14a-8047-4f28-a207-7743340b3149 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:34.145862 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d817b14a-8047-4f28-a207-7743340b3149 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:34.153290 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d817b14a-8047-4f28-a207-7743340b3149 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced" status: 200 len: 1313 microversion: 2.1 time: 0.154837 Jul 28 04:01:34.153848 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 180/330] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:33 2022] GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced => generated 1313 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:34.712494 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-8e7fe278-465d-441e-a3ba-29b4c0b624b8 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:34.713030 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-8e7fe278-465d-441e-a3ba-29b4c0b624b8 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:34.719624 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8e7fe278-465d-441e-a3ba-29b4c0b624b8 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:34.720164 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8e7fe278-465d-441e-a3ba-29b4c0b624b8 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:34.720928 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8e7fe278-465d-441e-a3ba-29b4c0b624b8 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:34.721364 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8e7fe278-465d-441e-a3ba-29b4c0b624b8 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:34.856760 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-8e7fe278-465d-441e-a3ba-29b4c0b624b8 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:34.864951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-8e7fe278-465d-441e-a3ba-29b4c0b624b8 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.156426 Jul 28 04:01:34.865515 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 151/331] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:34 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:35.174922 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-05b273a0-ed6e-44dc-b305-72c99286e20e tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:35.175544 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-05b273a0-ed6e-44dc-b305-72c99286e20e tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: 8adf9bc4-4136-466f-ab32-4711d9fa9ced] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:35.181554 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-05b273a0-ed6e-44dc-b305-72c99286e20e tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:35.182006 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-05b273a0-ed6e-44dc-b305-72c99286e20e tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:35.182771 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-05b273a0-ed6e-44dc-b305-72c99286e20e tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:35.183234 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-05b273a0-ed6e-44dc-b305-72c99286e20e tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:35.318906 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-05b273a0-ed6e-44dc-b305-72c99286e20e tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:35.327678 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-05b273a0-ed6e-44dc-b305-72c99286e20e tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced" status: 200 len: 1497 microversion: 2.1 time: 0.157152 Jul 28 04:01:35.328134 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 181/332] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:35 2022] GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced => generated 1497 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:35.886670 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-fe059585-6f33-4b41-a6a1-5434f992db7a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:35.887474 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-fe059585-6f33-4b41-a6a1-5434f992db7a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:35.895079 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fe059585-6f33-4b41-a6a1-5434f992db7a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:35.895722 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fe059585-6f33-4b41-a6a1-5434f992db7a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:35.896497 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fe059585-6f33-4b41-a6a1-5434f992db7a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:35.896925 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fe059585-6f33-4b41-a6a1-5434f992db7a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:36.043664 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-fe059585-6f33-4b41-a6a1-5434f992db7a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:36.051998 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-fe059585-6f33-4b41-a6a1-5434f992db7a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.169292 Jul 28 04:01:36.052560 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 152/333] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:35 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:36.250040 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-50af5a0f-ac59-46fb-a860-f5d5284c1c96 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:36.250686 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-50af5a0f-ac59-46fb-a860-f5d5284c1c96 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: 8adf9bc4-4136-466f-ab32-4711d9fa9ced] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:36.257458 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-50af5a0f-ac59-46fb-a860-f5d5284c1c96 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:36.257977 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-50af5a0f-ac59-46fb-a860-f5d5284c1c96 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:36.258908 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-50af5a0f-ac59-46fb-a860-f5d5284c1c96 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:36.259354 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-50af5a0f-ac59-46fb-a860-f5d5284c1c96 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:36.286068 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-50af5a0f-ac59-46fb-a860-f5d5284c1c96 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: 8adf9bc4-4136-466f-ab32-4711d9fa9ced] Going to try to terminate instance {{(pid=118187) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:01:36.366460 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-50af5a0f-ac59-46fb-a860-f5d5284c1c96 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced" status: 204 len: 0 microversion: 2.1 time: 0.119980 Jul 28 04:01:36.367189 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 182/334] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:01:36 2022] DELETE /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:01:36.378267 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-6efd0ec0-d32e-435a-b3dd-b45a972653ba tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:36.378926 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-6efd0ec0-d32e-435a-b3dd-b45a972653ba tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: 8adf9bc4-4136-466f-ab32-4711d9fa9ced] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:36.385212 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6efd0ec0-d32e-435a-b3dd-b45a972653ba tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:36.385652 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6efd0ec0-d32e-435a-b3dd-b45a972653ba tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:36.386416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6efd0ec0-d32e-435a-b3dd-b45a972653ba tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:36.386896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6efd0ec0-d32e-435a-b3dd-b45a972653ba tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:36.782606 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-6efd0ec0-d32e-435a-b3dd-b45a972653ba tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:36.790096 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-6efd0ec0-d32e-435a-b3dd-b45a972653ba tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced" status: 200 len: 1503 microversion: 2.1 time: 0.417872 Jul 28 04:01:36.790702 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 153/335] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:36 2022] GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced => generated 1503 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:37.075800 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a97bc396-8fc4-456c-a887-7b1ded2a7568 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:37.076496 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a97bc396-8fc4-456c-a887-7b1ded2a7568 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:37.083443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a97bc396-8fc4-456c-a887-7b1ded2a7568 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:37.083890 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a97bc396-8fc4-456c-a887-7b1ded2a7568 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:37.084711 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a97bc396-8fc4-456c-a887-7b1ded2a7568 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:37.085145 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a97bc396-8fc4-456c-a887-7b1ded2a7568 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:37.221627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a97bc396-8fc4-456c-a887-7b1ded2a7568 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:37.229810 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a97bc396-8fc4-456c-a887-7b1ded2a7568 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.158958 Jul 28 04:01:37.230384 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 183/336] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:37 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:37.234941 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-88d73013-7f48-4f4f-8c2d-f0f1c495da91 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d2b9140e-40c1-42fa-a950-1003ef497f9e"}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:37.237469 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-88d73013-7f48-4f4f-8c2d-f0f1c495da91 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:37.243934 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-88d73013-7f48-4f4f-8c2d-f0f1c495da91 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:37.244372 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-88d73013-7f48-4f4f-8c2d-f0f1c495da91 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:37.245124 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-88d73013-7f48-4f4f-8c2d-f0f1c495da91 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:37.245547 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-88d73013-7f48-4f4f-8c2d-f0f1c495da91 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:37.811299 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b1055d9e-ca96-4c87-acac-be4af8db16c9 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:37.811936 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b1055d9e-ca96-4c87-acac-be4af8db16c9 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: 8adf9bc4-4136-466f-ab32-4711d9fa9ced] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:37.818896 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b1055d9e-ca96-4c87-acac-be4af8db16c9 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:37.819338 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b1055d9e-ca96-4c87-acac-be4af8db16c9 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:37.820093 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b1055d9e-ca96-4c87-acac-be4af8db16c9 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:37.820524 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b1055d9e-ca96-4c87-acac-be4af8db16c9 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:37.838595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:37.960467 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b1055d9e-ca96-4c87-acac-be4af8db16c9 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:37.968118 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b1055d9e-ca96-4c87-acac-be4af8db16c9 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced" status: 200 len: 1503 microversion: 2.1 time: 0.160717 Jul 28 04:01:37.968688 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 184/337] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:37 2022] GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:38.250019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7f75243a-c1d8-4820-9630-cb728c865e9d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:38.251194 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7f75243a-c1d8-4820-9630-cb728c865e9d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:38.257482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7f75243a-c1d8-4820-9630-cb728c865e9d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:38.257930 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7f75243a-c1d8-4820-9630-cb728c865e9d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:38.258992 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7f75243a-c1d8-4820-9630-cb728c865e9d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:38.259631 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7f75243a-c1d8-4820-9630-cb728c865e9d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:38.400151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7f75243a-c1d8-4820-9630-cb728c865e9d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:38.408539 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7f75243a-c1d8-4820-9630-cb728c865e9d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.162418 Jul 28 04:01:38.409210 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 185/338] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:38 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:38.991179 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-88d508b9-5b81-4bcd-83e3-466fd54d908b tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:38.991807 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-88d508b9-5b81-4bcd-83e3-466fd54d908b tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: 8adf9bc4-4136-466f-ab32-4711d9fa9ced] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:38.997863 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-88d508b9-5b81-4bcd-83e3-466fd54d908b tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:38.998317 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-88d508b9-5b81-4bcd-83e3-466fd54d908b tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:38.999107 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-88d508b9-5b81-4bcd-83e3-466fd54d908b tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:38.999552 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-88d508b9-5b81-4bcd-83e3-466fd54d908b tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:39.128907 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=100 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:39.140127 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-88d508b9-5b81-4bcd-83e3-466fd54d908b tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:39.152009 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-88d508b9-5b81-4bcd-83e3-466fd54d908b tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced" status: 200 len: 1503 microversion: 2.1 time: 0.164586 Jul 28 04:01:39.152850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 186/339] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:38 2022] GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:39.261691 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-88d73013-7f48-4f4f-8c2d-f0f1c495da91 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "POST /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.030583 Jul 28 04:01:39.262296 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 154/340] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Jul 28 04:01:37 2022] POST /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475/os-volume_attachments => generated 194 bytes in 2032 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:01:39.432863 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3da75b33-e024-4c8f-8133-f3e9f76fa1f1 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:39.433495 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3da75b33-e024-4c8f-8133-f3e9f76fa1f1 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:39.444187 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3da75b33-e024-4c8f-8133-f3e9f76fa1f1 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:39.444649 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3da75b33-e024-4c8f-8133-f3e9f76fa1f1 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:39.445635 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3da75b33-e024-4c8f-8133-f3e9f76fa1f1 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:39.449406 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3da75b33-e024-4c8f-8133-f3e9f76fa1f1 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:39.626306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3da75b33-e024-4c8f-8133-f3e9f76fa1f1 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:39.643308 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3da75b33-e024-4c8f-8133-f3e9f76fa1f1 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.215501 Jul 28 04:01:39.644880 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 187/341] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:39 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:39.739467 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-0c984757-6b67-42d4-a0fd-a5014db8e882 req-ce3a77c6-3a28-4b05-8f60-0e2c5bf21884 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8adf9bc4-4136-466f-ab32-4711d9fa9ced", "name": "network-vif-deleted", "tag": "2973ff5a-fad6-4b3a-8698-ccf19f56a7a8"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:39.749555 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-0c984757-6b67-42d4-a0fd-a5014db8e882 req-ce3a77c6-3a28-4b05-8f60-0e2c5bf21884 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:39.749915 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-0c984757-6b67-42d4-a0fd-a5014db8e882 req-ce3a77c6-3a28-4b05-8f60-0e2c5bf21884 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:39.761530 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-0c984757-6b67-42d4-a0fd-a5014db8e882 req-ce3a77c6-3a28-4b05-8f60-0e2c5bf21884 service nova] Creating event network-vif-deleted:2973ff5a-fad6-4b3a-8698-ccf19f56a7a8 for instance 8adf9bc4-4136-466f-ab32-4711d9fa9ced on hv-cinder-79987 Jul 28 04:01:39.767643 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-0c984757-6b67-42d4-a0fd-a5014db8e882 req-ce3a77c6-3a28-4b05-8f60-0e2c5bf21884 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033364 Jul 28 04:01:39.768539 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 155/342] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:01:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:01:40.173997 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fdbbca61-4e84-4f10-80d6-1ff8b5f1a5c0 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:40.175208 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-fdbbca61-4e84-4f10-80d6-1ff8b5f1a5c0 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: 8adf9bc4-4136-466f-ab32-4711d9fa9ced] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:40.181038 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fdbbca61-4e84-4f10-80d6-1ff8b5f1a5c0 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:40.181484 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fdbbca61-4e84-4f10-80d6-1ff8b5f1a5c0 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:40.182393 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fdbbca61-4e84-4f10-80d6-1ff8b5f1a5c0 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:40.183008 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fdbbca61-4e84-4f10-80d6-1ff8b5f1a5c0 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:40.214303 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fdbbca61-4e84-4f10-80d6-1ff8b5f1a5c0 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:40.214886 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fdbbca61-4e84-4f10-80d6-1ff8b5f1a5c0 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:40.215580 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.objects.instance [None req-fdbbca61-4e84-4f10-80d6-1ff8b5f1a5c0 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lazy-loading 'fault' on Instance uuid 8adf9bc4-4136-466f-ab32-4711d9fa9ced {{(pid=118187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:01:40.261261 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-fdbbca61-4e84-4f10-80d6-1ff8b5f1a5c0 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820e385c27af49f08301be61fcde369b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9ed8ce4c8a3442deacf65acc0c05dad3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:40.269270 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-fdbbca61-4e84-4f10-80d6-1ff8b5f1a5c0 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced" status: 200 len: 1303 microversion: 2.1 time: 0.099696 Jul 28 04:01:40.269913 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 188/343] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:40 2022] GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced => generated 1303 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:40.591393 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-4552b1af-efb8-461a-9efd-4304ac37b3e6 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "78a9d74b-dfe6-49bd-a9f5-612fd320fb05", "device": "/dev/sdb"}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:40.594370 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-4552b1af-efb8-461a-9efd-4304ac37b3e6 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:40.600692 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4552b1af-efb8-461a-9efd-4304ac37b3e6 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:40.601143 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4552b1af-efb8-461a-9efd-4304ac37b3e6 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:40.602110 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4552b1af-efb8-461a-9efd-4304ac37b3e6 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:40.603313 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4552b1af-efb8-461a-9efd-4304ac37b3e6 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:40.668955 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7db18e59-f488-4a87-93ef-ae1d4224cab2 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:40.670209 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7db18e59-f488-4a87-93ef-ae1d4224cab2 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:40.679797 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7db18e59-f488-4a87-93ef-ae1d4224cab2 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:40.680255 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7db18e59-f488-4a87-93ef-ae1d4224cab2 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:40.681038 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7db18e59-f488-4a87-93ef-ae1d4224cab2 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:40.681481 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7db18e59-f488-4a87-93ef-ae1d4224cab2 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:40.850202 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7db18e59-f488-4a87-93ef-ae1d4224cab2 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:40.860157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7db18e59-f488-4a87-93ef-ae1d4224cab2 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.198302 Jul 28 04:01:40.871230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 189/344] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:40 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:40.899028 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-4552b1af-efb8-461a-9efd-4304ac37b3e6 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "POST /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.312350 Jul 28 04:01:40.899636 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 156/345] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Jul 28 04:01:40 2022] POST /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91/os-volume_attachments => generated 194 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:41.291557 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a7318a91-f775-4f26-8cbe-c506b3efdf95 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:41.292182 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a7318a91-f775-4f26-8cbe-c506b3efdf95 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] [instance: 8adf9bc4-4136-466f-ab32-4711d9fa9ced] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:41.298214 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7318a91-f775-4f26-8cbe-c506b3efdf95 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:41.298665 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7318a91-f775-4f26-8cbe-c506b3efdf95 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:41.299468 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7318a91-f775-4f26-8cbe-c506b3efdf95 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:41.299902 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7318a91-f775-4f26-8cbe-c506b3efdf95 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:41.313470 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-a7318a91-f775-4f26-8cbe-c506b3efdf95 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] HTTP exception thrown: Instance 8adf9bc4-4136-466f-ab32-4711d9fa9ced could not be found. Jul 28 04:01:41.315298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a7318a91-f775-4f26-8cbe-c506b3efdf95 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Request method failure captured: Jul 28 04:01:41.315298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced HTTP/1.1 Jul 28 04:01:41.315298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:01:41.315298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:01:41.315298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:01:41.315298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:01:41.315298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:01:41.315298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:01:41.315298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:01:41.315298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:01:41.315298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gnf4EsI6Q1n2ntTSkUCiStU610XIsT3_AFabfDUDH1LfWlD_pSVmVAxn7_I3J-fwyNBtSBVyoFug3arLC5FNcZPQfr7eyowKGHK1x1k-DsyRwtMb-i9_PmADj_wuXwzga5GIsJkCSZYCK_6LWp-beTDx-g9mACP6zAfDBdCVisnCnA Jul 28 04:01:41.315298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:01:41.315298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:01:41.315298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:01:41.315298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:01:41.315298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:01:41.315298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:01:41.315298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 9ed8ce4c8a3442deacf65acc0c05dad3 Jul 28 04:01:41.315298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-VolumesActionsTest-1602868677 Jul 28 04:01:41.315298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:01:41.315298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:01:41.316733 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9ed8ce4c8a3442deacf65acc0c05dad3", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9ed8ce4c8a3442deacf65acc0c05dad3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9ed8ce4c8a3442deacf65acc0c05dad3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9ed8ce4c8a3442deacf65acc0c05dad3"}]}] Jul 28 04:01:41.316733 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-VolumesActionsTest-1602868677 Jul 28 04:01:41.316733 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 9ed8ce4c8a3442deacf65acc0c05dad3 Jul 28 04:01:41.316733 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-VolumesActionsTest-1602868677 Jul 28 04:01:41.316733 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-VolumesActionsTest-1602868677-project Jul 28 04:01:41.316733 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:01:41.316733 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:01:41.316733 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: 820e385c27af49f08301be61fcde369b Jul 28 04:01:41.316733 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-VolumesActionsTest-1602868677-project Jul 28 04:01:41.316733 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:01:41.316733 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Instance 8adf9bc4-4136-466f-ab32-4711d9fa9ced could not be found. Jul 28 04:01:41.316733 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': '8adf9bc4-4136-466f-ab32-4711d9fa9ced'} Jul 28 04:01:41.323767 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:01:41.323767 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:01:41.323767 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:01:41.323767 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:01:41.323767 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:01:41.323767 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:01:41.323767 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:01:41.323767 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:01:41.323767 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:01:41.323767 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:01:41.323767 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8adf9bc4-4136-466f-ab32-4711d9fa9ced could not be found. Jul 28 04:01:41.323767 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:01:41.323767 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:01:41.323767 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:01:41.323767 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:01:41.323767 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:01:41.323767 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:01:41.323767 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:01:41.323767 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:01:41.323767 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:01:41.325008 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:01:41.325008 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:01:41.325008 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:01:41.325008 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:01:41.325008 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:01:41.325008 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:01:41.325008 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:01:41.325008 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8adf9bc4-4136-466f-ab32-4711d9fa9ced could not be found. Jul 28 04:01:41.325008 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:01:41.325008 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:01:41.325008 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:01:41.325008 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:01:41.325008 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:01:41.325008 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:01:41.325008 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:01:41.325008 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:01:41.325008 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8adf9bc4-4136-466f-ab32-4711d9fa9ced could not be found. Jul 28 04:01:41.325008 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:01:41.326037 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a7318a91-f775-4f26-8cbe-c506b3efdf95 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] Returning 404 to user: Instance 8adf9bc4-4136-466f-ab32-4711d9fa9ced could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:01:41.326037 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a7318a91-f775-4f26-8cbe-c506b3efdf95 tempest-VolumesActionsTest-1602868677 tempest-VolumesActionsTest-1602868677-project] 10.222.0.46 "GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced" status: 404 len: 111 microversion: 2.1 time: 0.029480 Jul 28 04:01:41.326037 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 190/346] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:41 2022] GET /compute/v2.1/servers/8adf9bc4-4136-466f-ab32-4711d9fa9ced => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:01:41.884552 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-83c21a34-e848-41fa-bc6d-4b49cacd3cde tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:41.885485 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-83c21a34-e848-41fa-bc6d-4b49cacd3cde tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:41.895862 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-83c21a34-e848-41fa-bc6d-4b49cacd3cde tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:41.896329 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-83c21a34-e848-41fa-bc6d-4b49cacd3cde tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:41.897166 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-83c21a34-e848-41fa-bc6d-4b49cacd3cde tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:41.897607 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-83c21a34-e848-41fa-bc6d-4b49cacd3cde tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:42.043766 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-83c21a34-e848-41fa-bc6d-4b49cacd3cde tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:42.057163 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-83c21a34-e848-41fa-bc6d-4b49cacd3cde tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.177815 Jul 28 04:01:42.057880 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 157/347] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:41 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:43.079567 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-87f5e0a3-2e32-44ec-80cb-8e00ed090c18 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:43.080176 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-87f5e0a3-2e32-44ec-80cb-8e00ed090c18 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:43.086392 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-87f5e0a3-2e32-44ec-80cb-8e00ed090c18 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:43.086891 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-87f5e0a3-2e32-44ec-80cb-8e00ed090c18 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:43.087663 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-87f5e0a3-2e32-44ec-80cb-8e00ed090c18 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:43.088102 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-87f5e0a3-2e32-44ec-80cb-8e00ed090c18 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:43.220124 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-87f5e0a3-2e32-44ec-80cb-8e00ed090c18 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:43.228435 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-87f5e0a3-2e32-44ec-80cb-8e00ed090c18 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.153257 Jul 28 04:01:43.229078 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 191/348] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:43 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:43.478402 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a99041ed-3644-4d45-a853-9c02b37f1b92 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:43.478954 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-a99041ed-3644-4d45-a853-9c02b37f1b92 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:43.485955 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a99041ed-3644-4d45-a853-9c02b37f1b92 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:43.486393 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a99041ed-3644-4d45-a853-9c02b37f1b92 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:43.487173 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a99041ed-3644-4d45-a853-9c02b37f1b92 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:43.487602 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a99041ed-3644-4d45-a853-9c02b37f1b92 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:43.509516 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-a99041ed-3644-4d45-a853-9c02b37f1b92 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131/ips" status: 200 len: 149 microversion: 2.1 time: 0.035334 Jul 28 04:01:43.510069 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 158/349] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Jul 28 04:01:43 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:44.249041 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d3693c7a-223c-4d73-8cf8-2b39684ab145 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:44.249787 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d3693c7a-223c-4d73-8cf8-2b39684ab145 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:44.255906 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d3693c7a-223c-4d73-8cf8-2b39684ab145 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:44.256359 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d3693c7a-223c-4d73-8cf8-2b39684ab145 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:44.257133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d3693c7a-223c-4d73-8cf8-2b39684ab145 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:44.257573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d3693c7a-223c-4d73-8cf8-2b39684ab145 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:44.384655 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d3693c7a-223c-4d73-8cf8-2b39684ab145 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:44.393042 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d3693c7a-223c-4d73-8cf8-2b39684ab145 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.147839 Jul 28 04:01:44.393605 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 192/350] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:44 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:45.414454 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-747e164a-9c20-4804-802b-c0dfd34defab tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:45.415108 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-747e164a-9c20-4804-802b-c0dfd34defab tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:45.421719 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-747e164a-9c20-4804-802b-c0dfd34defab tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:45.422801 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-747e164a-9c20-4804-802b-c0dfd34defab tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:45.423586 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-747e164a-9c20-4804-802b-c0dfd34defab tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:45.424029 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-747e164a-9c20-4804-802b-c0dfd34defab tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:45.559682 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-747e164a-9c20-4804-802b-c0dfd34defab tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:45.567322 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-747e164a-9c20-4804-802b-c0dfd34defab tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.157160 Jul 28 04:01:45.567876 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 159/351] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:45 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:46.587753 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-22e0306f-a004-493e-a8a7-9a5b2d35d84b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:46.588527 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-22e0306f-a004-493e-a8a7-9a5b2d35d84b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:46.595303 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-22e0306f-a004-493e-a8a7-9a5b2d35d84b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:46.595765 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-22e0306f-a004-493e-a8a7-9a5b2d35d84b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:46.596548 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-22e0306f-a004-493e-a8a7-9a5b2d35d84b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:46.596990 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-22e0306f-a004-493e-a8a7-9a5b2d35d84b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:46.734043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-22e0306f-a004-493e-a8a7-9a5b2d35d84b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:46.742087 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-22e0306f-a004-493e-a8a7-9a5b2d35d84b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.158800 Jul 28 04:01:46.756005 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 193/352] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:46 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:47.042082 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-eb97ab27-a690-46b9-a889-d2b396ba0300 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "558124de-09db-4b0a-8047-6a2c4c25da51"}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:47.045041 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-eb97ab27-a690-46b9-a889-d2b396ba0300 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:47.056689 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-eb97ab27-a690-46b9-a889-d2b396ba0300 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:47.057139 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-eb97ab27-a690-46b9-a889-d2b396ba0300 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:47.072714 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-eb97ab27-a690-46b9-a889-d2b396ba0300 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:47.073114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-eb97ab27-a690-46b9-a889-d2b396ba0300 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:47.721243 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-eb97ab27-a690-46b9-a889-d2b396ba0300 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "POST /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.683205 Jul 28 04:01:47.722138 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 160/353] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Jul 28 04:01:47 2022] POST /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131/os-volume_attachments => generated 194 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:01:47.792619 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3aca2c87-c03c-4c3b-a670-8c3a3bac23a3 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:47.792619 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3aca2c87-c03c-4c3b-a670-8c3a3bac23a3 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:47.792619 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3aca2c87-c03c-4c3b-a670-8c3a3bac23a3 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:47.792619 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3aca2c87-c03c-4c3b-a670-8c3a3bac23a3 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:47.793930 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3aca2c87-c03c-4c3b-a670-8c3a3bac23a3 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:47.793930 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3aca2c87-c03c-4c3b-a670-8c3a3bac23a3 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:48.038123 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3aca2c87-c03c-4c3b-a670-8c3a3bac23a3 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:48.048394 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3aca2c87-c03c-4c3b-a670-8c3a3bac23a3 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.287688 Jul 28 04:01:48.065043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 194/354] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:47 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:48.111018 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-435b0196-9ffe-4280-8bf3-d3463e04a308 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:01:48.120353 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-435b0196-9ffe-4280-8bf3-d3463e04a308 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:48.120797 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-435b0196-9ffe-4280-8bf3-d3463e04a308 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:48.219937 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-435b0196-9ffe-4280-8bf3-d3463e04a308 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Going to try to stop instance {{(pid=118186) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:01:48.289672 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-435b0196-9ffe-4280-8bf3-d3463e04a308 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "POST /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475/action" status: 202 len: 0 microversion: 2.1 time: 0.182624 Jul 28 04:01:48.294110 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 161/355] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Jul 28 04:01:48 2022] POST /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475/action => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:01:48.302546 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2de34c6a-6388-44d0-b8ac-345c06eca28b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:48.303559 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-2de34c6a-6388-44d0-b8ac-345c06eca28b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:48.312385 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2de34c6a-6388-44d0-b8ac-345c06eca28b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:48.314620 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2de34c6a-6388-44d0-b8ac-345c06eca28b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:48.317579 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2de34c6a-6388-44d0-b8ac-345c06eca28b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:48.318937 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2de34c6a-6388-44d0-b8ac-345c06eca28b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:48.513607 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-2de34c6a-6388-44d0-b8ac-345c06eca28b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:48.523408 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-2de34c6a-6388-44d0-b8ac-345c06eca28b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1722 microversion: 2.1 time: 0.227758 Jul 28 04:01:48.523906 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 195/356] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:48 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:49.073209 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-0c8afa48-e2b9-4b8c-ab17-343405d59b48 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:49.074182 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-0c8afa48-e2b9-4b8c-ab17-343405d59b48 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:49.084221 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0c8afa48-e2b9-4b8c-ab17-343405d59b48 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:49.084915 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0c8afa48-e2b9-4b8c-ab17-343405d59b48 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:49.086896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0c8afa48-e2b9-4b8c-ab17-343405d59b48 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:49.087540 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0c8afa48-e2b9-4b8c-ab17-343405d59b48 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:49.247441 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-0c8afa48-e2b9-4b8c-ab17-343405d59b48 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:49.258995 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-0c8afa48-e2b9-4b8c-ab17-343405d59b48 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.189923 Jul 28 04:01:49.274939 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 162/357] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:49 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:49.548821 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-346bc6a7-17b8-4d9c-a03b-f88e8d44a644 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:49.549432 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-346bc6a7-17b8-4d9c-a03b-f88e8d44a644 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:49.564007 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-346bc6a7-17b8-4d9c-a03b-f88e8d44a644 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:49.564461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-346bc6a7-17b8-4d9c-a03b-f88e8d44a644 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:49.565246 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-346bc6a7-17b8-4d9c-a03b-f88e8d44a644 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:49.565684 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-346bc6a7-17b8-4d9c-a03b-f88e8d44a644 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:49.716556 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-346bc6a7-17b8-4d9c-a03b-f88e8d44a644 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:49.725583 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-346bc6a7-17b8-4d9c-a03b-f88e8d44a644 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1722 microversion: 2.1 time: 0.182783 Jul 28 04:01:49.726577 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 196/358] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:49 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:50.282073 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-528d44db-0711-4623-8ae9-cef313c559c4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:50.282857 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-528d44db-0711-4623-8ae9-cef313c559c4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:50.289635 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-528d44db-0711-4623-8ae9-cef313c559c4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:50.290441 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-528d44db-0711-4623-8ae9-cef313c559c4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:50.291299 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-528d44db-0711-4623-8ae9-cef313c559c4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:50.292296 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-528d44db-0711-4623-8ae9-cef313c559c4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:50.515521 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-528d44db-0711-4623-8ae9-cef313c559c4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:50.545199 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-528d44db-0711-4623-8ae9-cef313c559c4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.262069 Jul 28 04:01:50.545199 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 163/359] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:50 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:50.752942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3bcbb42f-0e9d-43e5-a51d-1b32c7850e1d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:50.753712 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3bcbb42f-0e9d-43e5-a51d-1b32c7850e1d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:50.769246 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3bcbb42f-0e9d-43e5-a51d-1b32c7850e1d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:50.769757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3bcbb42f-0e9d-43e5-a51d-1b32c7850e1d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:50.771061 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3bcbb42f-0e9d-43e5-a51d-1b32c7850e1d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:50.774372 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3bcbb42f-0e9d-43e5-a51d-1b32c7850e1d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:51.009728 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3bcbb42f-0e9d-43e5-a51d-1b32c7850e1d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:51.019195 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3bcbb42f-0e9d-43e5-a51d-1b32c7850e1d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1722 microversion: 2.1 time: 0.275932 Jul 28 04:01:51.033213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 197/360] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:50 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1722 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:51.569520 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-90eaf262-5349-45da-ba26-11f6db7fe809 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:51.571988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-90eaf262-5349-45da-ba26-11f6db7fe809 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:51.586720 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-90eaf262-5349-45da-ba26-11f6db7fe809 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:51.587599 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-90eaf262-5349-45da-ba26-11f6db7fe809 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:51.588923 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-90eaf262-5349-45da-ba26-11f6db7fe809 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:51.589589 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-90eaf262-5349-45da-ba26-11f6db7fe809 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:51.794992 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-90eaf262-5349-45da-ba26-11f6db7fe809 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:51.804945 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-90eaf262-5349-45da-ba26-11f6db7fe809 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.246357 Jul 28 04:01:51.805638 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 164/361] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:51 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:52.040805 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b184b8b7-8fd9-4430-9b7d-15dc6a0bf329 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:52.041568 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b184b8b7-8fd9-4430-9b7d-15dc6a0bf329 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:52.048556 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b184b8b7-8fd9-4430-9b7d-15dc6a0bf329 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:52.049013 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b184b8b7-8fd9-4430-9b7d-15dc6a0bf329 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:52.049809 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b184b8b7-8fd9-4430-9b7d-15dc6a0bf329 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:52.051185 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b184b8b7-8fd9-4430-9b7d-15dc6a0bf329 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:52.216570 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b184b8b7-8fd9-4430-9b7d-15dc6a0bf329 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:52.226174 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b184b8b7-8fd9-4430-9b7d-15dc6a0bf329 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1722 microversion: 2.1 time: 0.189742 Jul 28 04:01:52.227460 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 198/362] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:52 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:52.847300 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-0f4ab158-a4cd-4400-9cc2-721fd4674087 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:52.848991 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-0f4ab158-a4cd-4400-9cc2-721fd4674087 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:52.863784 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0f4ab158-a4cd-4400-9cc2-721fd4674087 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:52.864624 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0f4ab158-a4cd-4400-9cc2-721fd4674087 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:52.866005 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0f4ab158-a4cd-4400-9cc2-721fd4674087 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:52.866683 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0f4ab158-a4cd-4400-9cc2-721fd4674087 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:53.187975 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-0f4ab158-a4cd-4400-9cc2-721fd4674087 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:53.205524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-0f4ab158-a4cd-4400-9cc2-721fd4674087 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.381050 Jul 28 04:01:53.206882 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 165/363] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:52 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:53.249573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a54af884-96f9-4b27-a23d-b96610808c67 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:53.251687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a54af884-96f9-4b27-a23d-b96610808c67 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:53.260019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a54af884-96f9-4b27-a23d-b96610808c67 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:53.260472 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a54af884-96f9-4b27-a23d-b96610808c67 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:53.261252 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a54af884-96f9-4b27-a23d-b96610808c67 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:53.268209 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a54af884-96f9-4b27-a23d-b96610808c67 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:53.478190 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a54af884-96f9-4b27-a23d-b96610808c67 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:53.488605 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a54af884-96f9-4b27-a23d-b96610808c67 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1722 microversion: 2.1 time: 0.242903 Jul 28 04:01:53.499738 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 199/364] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:53 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1722 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:54.231417 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-e2a52684-3eb3-4b4b-aff2-480fc6874377 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:54.232878 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-e2a52684-3eb3-4b4b-aff2-480fc6874377 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:54.259130 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e2a52684-3eb3-4b4b-aff2-480fc6874377 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:54.260300 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e2a52684-3eb3-4b4b-aff2-480fc6874377 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:54.263872 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e2a52684-3eb3-4b4b-aff2-480fc6874377 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:54.266045 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e2a52684-3eb3-4b4b-aff2-480fc6874377 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:54.515182 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ba60ab2c-5537-43b7-a1d9-f77bb8123600 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:54.516588 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ba60ab2c-5537-43b7-a1d9-f77bb8123600 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:54.544705 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ba60ab2c-5537-43b7-a1d9-f77bb8123600 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:54.544705 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ba60ab2c-5537-43b7-a1d9-f77bb8123600 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:54.545729 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ba60ab2c-5537-43b7-a1d9-f77bb8123600 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:54.546069 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ba60ab2c-5537-43b7-a1d9-f77bb8123600 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:54.607223 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-e2a52684-3eb3-4b4b-aff2-480fc6874377 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:54.617267 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-e2a52684-3eb3-4b4b-aff2-480fc6874377 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.391261 Jul 28 04:01:54.618441 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 166/365] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:54 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:54.790335 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ba60ab2c-5537-43b7-a1d9-f77bb8123600 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:54.801301 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ba60ab2c-5537-43b7-a1d9-f77bb8123600 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1722 microversion: 2.1 time: 0.290025 Jul 28 04:01:54.802941 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 200/366] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:54 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1722 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:55.638376 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-b5675c9c-deb5-49ca-8930-bc862bee1cef tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:55.639029 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-b5675c9c-deb5-49ca-8930-bc862bee1cef tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:55.645820 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b5675c9c-deb5-49ca-8930-bc862bee1cef tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:55.646272 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b5675c9c-deb5-49ca-8930-bc862bee1cef tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:55.647063 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b5675c9c-deb5-49ca-8930-bc862bee1cef tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:55.647503 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b5675c9c-deb5-49ca-8930-bc862bee1cef tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:55.787492 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-b5675c9c-deb5-49ca-8930-bc862bee1cef tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:55.790172 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:UPDATE=7,nova_cell1:SELECT=89,nova_cell1:INSERT=4 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:55.798373 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-b5675c9c-deb5-49ca-8930-bc862bee1cef tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.163397 Jul 28 04:01:55.798978 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 167/367] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:55 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:55.825795 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9094d083-82be-4758-95e7-8ff48c821b9c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:55.826416 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9094d083-82be-4758-95e7-8ff48c821b9c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:55.833474 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9094d083-82be-4758-95e7-8ff48c821b9c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:55.833922 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9094d083-82be-4758-95e7-8ff48c821b9c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:55.834681 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9094d083-82be-4758-95e7-8ff48c821b9c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:55.835145 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9094d083-82be-4758-95e7-8ff48c821b9c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:55.854116 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=100 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:55.969703 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9094d083-82be-4758-95e7-8ff48c821b9c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:55.977697 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9094d083-82be-4758-95e7-8ff48c821b9c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1722 microversion: 2.1 time: 0.155913 Jul 28 04:01:55.978260 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 201/368] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:55 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:56.818879 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-3f170a31-68e6-4003-a182-a655f0cf8419 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:56.819491 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-3f170a31-68e6-4003-a182-a655f0cf8419 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:56.827215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3f170a31-68e6-4003-a182-a655f0cf8419 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:56.827657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3f170a31-68e6-4003-a182-a655f0cf8419 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:56.829037 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3f170a31-68e6-4003-a182-a655f0cf8419 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:56.829465 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3f170a31-68e6-4003-a182-a655f0cf8419 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:56.958466 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-3f170a31-68e6-4003-a182-a655f0cf8419 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:56.965873 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-3f170a31-68e6-4003-a182-a655f0cf8419 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.150876 Jul 28 04:01:56.966433 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 168/369] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:56 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:56.999291 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-42fa367c-1a78-4eb7-8058-5d5bc57c4dee tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:56.999961 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-42fa367c-1a78-4eb7-8058-5d5bc57c4dee tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:57.005932 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-42fa367c-1a78-4eb7-8058-5d5bc57c4dee tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:57.006385 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-42fa367c-1a78-4eb7-8058-5d5bc57c4dee tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:57.007179 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-42fa367c-1a78-4eb7-8058-5d5bc57c4dee tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:57.007621 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-42fa367c-1a78-4eb7-8058-5d5bc57c4dee tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:57.137731 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-42fa367c-1a78-4eb7-8058-5d5bc57c4dee tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:57.146186 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-42fa367c-1a78-4eb7-8058-5d5bc57c4dee tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1722 microversion: 2.1 time: 0.150701 Jul 28 04:01:57.146753 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 202/370] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:56 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:57.988331 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-4916e73b-44d7-445b-8fed-18aad0e3cdf7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:57.988946 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-4916e73b-44d7-445b-8fed-18aad0e3cdf7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:57.995526 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4916e73b-44d7-445b-8fed-18aad0e3cdf7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:57.996175 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4916e73b-44d7-445b-8fed-18aad0e3cdf7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:57.997100 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4916e73b-44d7-445b-8fed-18aad0e3cdf7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:57.997529 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4916e73b-44d7-445b-8fed-18aad0e3cdf7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:58.164515 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-4916e73b-44d7-445b-8fed-18aad0e3cdf7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:58.168313 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-61e074fc-f62a-4b27-8de1-d6b5c60cb76c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:58.169025 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-61e074fc-f62a-4b27-8de1-d6b5c60cb76c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:58.174242 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-4916e73b-44d7-445b-8fed-18aad0e3cdf7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.190378 Jul 28 04:01:58.174930 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 169/371] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:57 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:58.175616 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-61e074fc-f62a-4b27-8de1-d6b5c60cb76c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:58.176074 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-61e074fc-f62a-4b27-8de1-d6b5c60cb76c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:58.177023 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-61e074fc-f62a-4b27-8de1-d6b5c60cb76c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:58.177647 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-61e074fc-f62a-4b27-8de1-d6b5c60cb76c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:58.330266 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-61e074fc-f62a-4b27-8de1-d6b5c60cb76c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:58.339646 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-61e074fc-f62a-4b27-8de1-d6b5c60cb76c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1722 microversion: 2.1 time: 0.175185 Jul 28 04:01:58.340231 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 203/372] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:58 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:01:59.197876 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-bc9bbaca-d2d2-4ac0-85ba-50948a50894f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:59.199122 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-bc9bbaca-d2d2-4ac0-85ba-50948a50894f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:59.206607 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bc9bbaca-d2d2-4ac0-85ba-50948a50894f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:59.207096 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bc9bbaca-d2d2-4ac0-85ba-50948a50894f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:59.208284 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bc9bbaca-d2d2-4ac0-85ba-50948a50894f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:59.208729 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bc9bbaca-d2d2-4ac0-85ba-50948a50894f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:59.362284 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-507f1d43-6fd7-4cf1-b5b5-0914367f39d8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:01:59.362928 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-507f1d43-6fd7-4cf1-b5b5-0914367f39d8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:01:59.364839 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:01:59.368630 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-bc9bbaca-d2d2-4ac0-85ba-50948a50894f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:59.370113 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-507f1d43-6fd7-4cf1-b5b5-0914367f39d8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:59.370576 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-507f1d43-6fd7-4cf1-b5b5-0914367f39d8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:59.371378 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-507f1d43-6fd7-4cf1-b5b5-0914367f39d8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:01:59.371815 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-507f1d43-6fd7-4cf1-b5b5-0914367f39d8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:01:59.377039 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-bc9bbaca-d2d2-4ac0-85ba-50948a50894f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.183955 Jul 28 04:01:59.377629 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 170/373] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:59 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:01:59.503789 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-507f1d43-6fd7-4cf1-b5b5-0914367f39d8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:01:59.511928 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-507f1d43-6fd7-4cf1-b5b5-0914367f39d8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1722 microversion: 2.1 time: 0.154257 Jul 28 04:01:59.512495 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 204/374] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:01:59 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:00.399005 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-5d2f0f2a-bfd2-4dc9-b762-72951dcd3e35 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:00.399617 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-5d2f0f2a-bfd2-4dc9-b762-72951dcd3e35 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:00.406125 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5d2f0f2a-bfd2-4dc9-b762-72951dcd3e35 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:00.406730 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5d2f0f2a-bfd2-4dc9-b762-72951dcd3e35 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:00.407540 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5d2f0f2a-bfd2-4dc9-b762-72951dcd3e35 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:00.408098 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5d2f0f2a-bfd2-4dc9-b762-72951dcd3e35 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:00.533905 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3d404101-1597-4bbb-b322-052fea02af5a tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:00.535305 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3d404101-1597-4bbb-b322-052fea02af5a tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:00.541747 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3d404101-1597-4bbb-b322-052fea02af5a tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:00.543059 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3d404101-1597-4bbb-b322-052fea02af5a tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:00.543835 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3d404101-1597-4bbb-b322-052fea02af5a tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:00.544268 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3d404101-1597-4bbb-b322-052fea02af5a tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:00.549835 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-5d2f0f2a-bfd2-4dc9-b762-72951dcd3e35 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:00.560402 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-5d2f0f2a-bfd2-4dc9-b762-72951dcd3e35 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.165563 Jul 28 04:02:00.560983 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 171/375] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:00 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:00.684540 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3d404101-1597-4bbb-b322-052fea02af5a tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:00.693512 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3d404101-1597-4bbb-b322-052fea02af5a tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1722 microversion: 2.1 time: 0.164017 Jul 28 04:02:00.694171 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 205/376] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:00 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:01.583243 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-f7bc5333-e3a6-40c4-9c38-641bdc6873ba tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:01.584816 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-f7bc5333-e3a6-40c4-9c38-641bdc6873ba tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:01.597488 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f7bc5333-e3a6-40c4-9c38-641bdc6873ba tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:01.598285 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f7bc5333-e3a6-40c4-9c38-641bdc6873ba tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:01.599291 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f7bc5333-e3a6-40c4-9c38-641bdc6873ba tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:01.599938 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f7bc5333-e3a6-40c4-9c38-641bdc6873ba tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:01.718165 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f4df48c6-b8ab-41ba-9487-bebd75479cab tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:01.718809 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f4df48c6-b8ab-41ba-9487-bebd75479cab tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:01.728348 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f4df48c6-b8ab-41ba-9487-bebd75479cab tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:01.729715 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f4df48c6-b8ab-41ba-9487-bebd75479cab tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:01.734158 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f4df48c6-b8ab-41ba-9487-bebd75479cab tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:01.734940 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f4df48c6-b8ab-41ba-9487-bebd75479cab tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:01.859168 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-f7bc5333-e3a6-40c4-9c38-641bdc6873ba tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:01.868104 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-f7bc5333-e3a6-40c4-9c38-641bdc6873ba tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.289834 Jul 28 04:02:01.868825 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 172/377] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:01 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:01.927062 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f4df48c6-b8ab-41ba-9487-bebd75479cab tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:01.935891 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f4df48c6-b8ab-41ba-9487-bebd75479cab tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1722 microversion: 2.1 time: 0.223666 Jul 28 04:02:01.936809 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 206/378] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:01 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:02.943130 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-3e71c814-8522-4996-831e-961090c096bc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:02.944771 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-3e71c814-8522-4996-831e-961090c096bc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:02.955028 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3e71c814-8522-4996-831e-961090c096bc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:02.955961 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3e71c814-8522-4996-831e-961090c096bc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:02.957060 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3e71c814-8522-4996-831e-961090c096bc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:02.957614 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3e71c814-8522-4996-831e-961090c096bc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:03.023351 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ada0fef9-1a05-4cb1-a49b-31f6c593ff5e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:03.024145 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ada0fef9-1a05-4cb1-a49b-31f6c593ff5e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:03.036729 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ada0fef9-1a05-4cb1-a49b-31f6c593ff5e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:03.038134 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ada0fef9-1a05-4cb1-a49b-31f6c593ff5e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:03.041098 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ada0fef9-1a05-4cb1-a49b-31f6c593ff5e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:03.043573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ada0fef9-1a05-4cb1-a49b-31f6c593ff5e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:03.141312 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-3e71c814-8522-4996-831e-961090c096bc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:03.159027 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-3e71c814-8522-4996-831e-961090c096bc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.223696 Jul 28 04:02:03.160193 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 173/379] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:02 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:03.274230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ada0fef9-1a05-4cb1-a49b-31f6c593ff5e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:03.286281 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ada0fef9-1a05-4cb1-a49b-31f6c593ff5e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1722 microversion: 2.1 time: 0.286503 Jul 28 04:02:03.287152 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 207/380] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:02 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1722 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:04.182080 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-b49663fd-735d-4d8d-ba9a-e9a6d4bf1716 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:04.183356 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-b49663fd-735d-4d8d-ba9a-e9a6d4bf1716 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:04.191264 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=48 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:04.194187 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b49663fd-735d-4d8d-ba9a-e9a6d4bf1716 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:04.195664 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b49663fd-735d-4d8d-ba9a-e9a6d4bf1716 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:04.197576 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b49663fd-735d-4d8d-ba9a-e9a6d4bf1716 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:04.198608 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b49663fd-735d-4d8d-ba9a-e9a6d4bf1716 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:04.241343 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a6746198-56f9-4e2e-942b-aa4e70008a56 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Action: 'create', calling method: .version_select at 0x7fa6ee24c790>, body: {"keypair": {"name": "tempest-keypair-1140484560", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHduZUD2wq4a2hCKcf8Rz+7NDT8nIKFqmqlYAUdsPYUlbhiQklMztrl8/VEuCxPAZLIqeoBW7FKicTt3Mnk2oB6fppHt93SEFJfe+aIGaOfveqceS/zla17aqz2zExKlXA=="}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:04.279282 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-a6746198-56f9-4e2e-942b-aa4e70008a56 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Getting quotas for project 18a927e9f5da42d7b34752c8b2db211a. Resources: {'key_pairs'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:02:04.284311 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-a6746198-56f9-4e2e-942b-aa4e70008a56 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Getting quotas for user c3308761e9d2495e95e127bbc7b9c5e2 and project 18a927e9f5da42d7b34752c8b2db211a. Resources: {'key_pairs'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:02:04.321658 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a6746198-56f9-4e2e-942b-aa4e70008a56 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.084189 Jul 28 04:02:04.325095 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 208/381] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 04:02:04 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:02:04.364786 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-67ad1703-a5f1-4c92-a764-286b9896a81c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:04.370491 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-67ad1703-a5f1-4c92-a764-286b9896a81c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:04.402528 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-67ad1703-a5f1-4c92-a764-286b9896a81c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:04.412047 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-67ad1703-a5f1-4c92-a764-286b9896a81c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:04.413264 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-67ad1703-a5f1-4c92-a764-286b9896a81c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:04.415343 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-67ad1703-a5f1-4c92-a764-286b9896a81c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:04.468965 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-b49663fd-735d-4d8d-ba9a-e9a6d4bf1716 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:04.478880 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-b49663fd-735d-4d8d-ba9a-e9a6d4bf1716 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.301609 Jul 28 04:02:04.480678 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 174/382] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:04 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:04.706488 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-67ad1703-a5f1-4c92-a764-286b9896a81c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:04.714672 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-67ad1703-a5f1-4c92-a764-286b9896a81c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1722 microversion: 2.1 time: 0.388151 Jul 28 04:02:04.715278 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 209/383] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:04 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1722 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:05.503519 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-3133b15b-cee9-421e-ad1a-257a2219634a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:05.504484 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-3133b15b-cee9-421e-ad1a-257a2219634a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:05.512097 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3133b15b-cee9-421e-ad1a-257a2219634a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:05.512630 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3133b15b-cee9-421e-ad1a-257a2219634a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:05.513485 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3133b15b-cee9-421e-ad1a-257a2219634a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:05.514254 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3133b15b-cee9-421e-ad1a-257a2219634a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:05.724958 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-3133b15b-cee9-421e-ad1a-257a2219634a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:05.734001 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-3133b15b-cee9-421e-ad1a-257a2219634a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.235547 Jul 28 04:02:05.734657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 175/384] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:05 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:05.736820 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c52ef725-c5bc-4242-8482-241715d69499 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:05.737423 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c52ef725-c5bc-4242-8482-241715d69499 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:05.743660 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c52ef725-c5bc-4242-8482-241715d69499 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:05.744301 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c52ef725-c5bc-4242-8482-241715d69499 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:05.745227 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c52ef725-c5bc-4242-8482-241715d69499 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:05.746492 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c52ef725-c5bc-4242-8482-241715d69499 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:05.879235 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c52ef725-c5bc-4242-8482-241715d69499 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:05.887531 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c52ef725-c5bc-4242-8482-241715d69499 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1722 microversion: 2.1 time: 0.155306 Jul 28 04:02:05.888093 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 210/385] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:05 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:05.937101 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-6857245f-fd36-4a2a-a6c0-d0e05826474e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1110365323", "imageRef": "a0eec51c-83e9-420b-bcb9-20fe8dcf5321", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21c60ecd-c113-4857-a1b5-c85ec6a7053f"}], "security_groups": [{"name": "tempest-securitygroup--388249166"}], "key_name": "tempest-keypair-1140484560", "user_data": "}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:06.756355 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b604756c-9b16-470d-b76a-40b094a7cda5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:06.756898 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b604756c-9b16-470d-b76a-40b094a7cda5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:06.763552 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b604756c-9b16-470d-b76a-40b094a7cda5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:06.764115 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b604756c-9b16-470d-b76a-40b094a7cda5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:06.765245 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b604756c-9b16-470d-b76a-40b094a7cda5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:06.765719 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b604756c-9b16-470d-b76a-40b094a7cda5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:06.904510 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b604756c-9b16-470d-b76a-40b094a7cda5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:06.914727 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b604756c-9b16-470d-b76a-40b094a7cda5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.162384 Jul 28 04:02:06.915450 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 211/386] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:06 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:06.920047 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6eb75daa-b01c-4864-bcfc-1bea684bcaa8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:06.920875 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6eb75daa-b01c-4864-bcfc-1bea684bcaa8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:06.927160 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6eb75daa-b01c-4864-bcfc-1bea684bcaa8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:06.927640 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6eb75daa-b01c-4864-bcfc-1bea684bcaa8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:06.928665 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6eb75daa-b01c-4864-bcfc-1bea684bcaa8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:06.929281 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6eb75daa-b01c-4864-bcfc-1bea684bcaa8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:07.075769 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6eb75daa-b01c-4864-bcfc-1bea684bcaa8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:07.084762 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6eb75daa-b01c-4864-bcfc-1bea684bcaa8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1722 microversion: 2.1 time: 0.168295 Jul 28 04:02:07.085481 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 212/387] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:06 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:07.935871 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-364042ba-9046-49f3-ad05-75d2d36340d2 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:07.936503 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-364042ba-9046-49f3-ad05-75d2d36340d2 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:07.942540 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-364042ba-9046-49f3-ad05-75d2d36340d2 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:07.943069 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-364042ba-9046-49f3-ad05-75d2d36340d2 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:07.943797 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-364042ba-9046-49f3-ad05-75d2d36340d2 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:07.944238 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-364042ba-9046-49f3-ad05-75d2d36340d2 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:08.072094 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-364042ba-9046-49f3-ad05-75d2d36340d2 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:08.080317 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-364042ba-9046-49f3-ad05-75d2d36340d2 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.147606 Jul 28 04:02:08.080898 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 213/388] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:07 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:08.106242 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-08021df7-21cc-4481-aacc-48cc1e968d8f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:08.106926 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-08021df7-21cc-4481-aacc-48cc1e968d8f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:08.112747 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-08021df7-21cc-4481-aacc-48cc1e968d8f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:08.113203 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-08021df7-21cc-4481-aacc-48cc1e968d8f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:08.113969 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-08021df7-21cc-4481-aacc-48cc1e968d8f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:08.114409 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-08021df7-21cc-4481-aacc-48cc1e968d8f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:08.245306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-08021df7-21cc-4481-aacc-48cc1e968d8f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:08.253927 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-08021df7-21cc-4481-aacc-48cc1e968d8f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1722 microversion: 2.1 time: 0.151179 Jul 28 04:02:08.254482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 214/389] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:08 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:09.101693 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-13abba6c-7d86-4d4d-8105-e616729a5cdb tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:09.102303 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-13abba6c-7d86-4d4d-8105-e616729a5cdb tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:09.108415 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-13abba6c-7d86-4d4d-8105-e616729a5cdb tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:09.108859 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-13abba6c-7d86-4d4d-8105-e616729a5cdb tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:09.109606 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-13abba6c-7d86-4d4d-8105-e616729a5cdb tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:09.110038 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-13abba6c-7d86-4d4d-8105-e616729a5cdb tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:09.240898 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-13abba6c-7d86-4d4d-8105-e616729a5cdb tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:09.248435 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-13abba6c-7d86-4d4d-8105-e616729a5cdb tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.150492 Jul 28 04:02:09.248952 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 215/390] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:09 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:09.274806 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-24ee5c03-78db-4239-be47-0bb351f7d5eb tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:09.275421 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-24ee5c03-78db-4239-be47-0bb351f7d5eb tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:09.283999 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-24ee5c03-78db-4239-be47-0bb351f7d5eb tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:09.284452 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-24ee5c03-78db-4239-be47-0bb351f7d5eb tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:09.285221 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-24ee5c03-78db-4239-be47-0bb351f7d5eb tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:09.285653 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-24ee5c03-78db-4239-be47-0bb351f7d5eb tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:09.410525 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-24ee5c03-78db-4239-be47-0bb351f7d5eb tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:09.418724 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-24ee5c03-78db-4239-be47-0bb351f7d5eb tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1722 microversion: 2.1 time: 0.147545 Jul 28 04:02:09.419326 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 216/391] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:09 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1722 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:10.269098 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6d94cb7c-7e68-4fce-aae8-9ba4b8ebb07a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:10.269762 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6d94cb7c-7e68-4fce-aae8-9ba4b8ebb07a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:10.275949 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6d94cb7c-7e68-4fce-aae8-9ba4b8ebb07a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:10.276402 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6d94cb7c-7e68-4fce-aae8-9ba4b8ebb07a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:10.277163 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6d94cb7c-7e68-4fce-aae8-9ba4b8ebb07a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:10.277599 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6d94cb7c-7e68-4fce-aae8-9ba4b8ebb07a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:10.422141 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6d94cb7c-7e68-4fce-aae8-9ba4b8ebb07a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:10.431137 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6d94cb7c-7e68-4fce-aae8-9ba4b8ebb07a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.165805 Jul 28 04:02:10.431894 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 217/392] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:10 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:10.439963 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5c6a8b5c-5b3d-4bcb-8560-5ac64b9dc2bf tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:10.440692 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5c6a8b5c-5b3d-4bcb-8560-5ac64b9dc2bf tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:10.447571 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5c6a8b5c-5b3d-4bcb-8560-5ac64b9dc2bf tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:10.448135 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5c6a8b5c-5b3d-4bcb-8560-5ac64b9dc2bf tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:10.448967 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5c6a8b5c-5b3d-4bcb-8560-5ac64b9dc2bf tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:10.449495 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5c6a8b5c-5b3d-4bcb-8560-5ac64b9dc2bf tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:10.597305 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5c6a8b5c-5b3d-4bcb-8560-5ac64b9dc2bf tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:10.607025 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5c6a8b5c-5b3d-4bcb-8560-5ac64b9dc2bf tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1722 microversion: 2.1 time: 0.170486 Jul 28 04:02:10.607658 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 218/393] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:10 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:11.458462 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9630b8cd-aa13-4c23-9833-820f37501ee9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:11.459289 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9630b8cd-aa13-4c23-9833-820f37501ee9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:11.465405 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9630b8cd-aa13-4c23-9833-820f37501ee9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:11.466074 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9630b8cd-aa13-4c23-9833-820f37501ee9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:11.466938 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9630b8cd-aa13-4c23-9833-820f37501ee9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:11.467442 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9630b8cd-aa13-4c23-9833-820f37501ee9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:11.472282 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=100 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:11.619035 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9630b8cd-aa13-4c23-9833-820f37501ee9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:11.627947 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9630b8cd-aa13-4c23-9833-820f37501ee9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1502 microversion: 2.1 time: 0.174155 Jul 28 04:02:11.628526 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 219/394] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:11 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1502 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:11.633248 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6a2c634f-022c-4b9b-883b-ae8d5ed5b65b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:11.633867 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6a2c634f-022c-4b9b-883b-ae8d5ed5b65b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:11.640093 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6a2c634f-022c-4b9b-883b-ae8d5ed5b65b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:11.640536 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6a2c634f-022c-4b9b-883b-ae8d5ed5b65b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:11.641458 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6a2c634f-022c-4b9b-883b-ae8d5ed5b65b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:11.642641 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6a2c634f-022c-4b9b-883b-ae8d5ed5b65b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:11.789236 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6a2c634f-022c-4b9b-883b-ae8d5ed5b65b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:11.798485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6a2c634f-022c-4b9b-883b-ae8d5ed5b65b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1699 microversion: 2.1 time: 0.168957 Jul 28 04:02:11.799367 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 220/395] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:11 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1699 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:11.815584 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-85c437ba-5b20-4f77-91d1-f45b9add6259 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6c0ab361-373b-4723-bce3-e251dcd1073f"}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:11.818026 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-85c437ba-5b20-4f77-91d1-f45b9add6259 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:11.833978 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-85c437ba-5b20-4f77-91d1-f45b9add6259 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:11.834432 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-85c437ba-5b20-4f77-91d1-f45b9add6259 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:11.835530 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-85c437ba-5b20-4f77-91d1-f45b9add6259 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:11.835977 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-85c437ba-5b20-4f77-91d1-f45b9add6259 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:11.872307 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-85c437ba-5b20-4f77-91d1-f45b9add6259 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] HTTP exception thrown: Cannot 'attach_volume' instance 54fdcaaa-031e-4509-b8a7-6b284460c7d2 while it is in vm_state rescued Jul 28 04:02:11.873987 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-85c437ba-5b20-4f77-91d1-f45b9add6259 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Request method failure captured: Jul 28 04:02:11.873987 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: POST /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2/os-volume_attachments HTTP/1.1 Jul 28 04:02:11.873987 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:02:11.873987 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:02:11.873987 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:02:11.873987 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 74 Jul 28 04:02:11.873987 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:02:11.873987 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:02:11.873987 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:02:11.873987 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:02:11.873987 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gmx9saU6X6wXaut0oV-DgXC4eOrOdUPDpTL-be51IOCob459Vnx3p8cEv5I-817MPvea-z5B1wjBZmkZVFZyS4Z5HE0xs4B5dv5vHGJrJ18ZwqUg2jQyx-xGnyCE7MhhFmKrX3UvKtRA53M9fiu3ycBzv2wFrj6Q7c0TYYzfm06pvY Jul 28 04:02:11.873987 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:02:11.873987 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:02:11.873987 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:02:11.873987 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:02:11.873987 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:02:11.873987 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:02:11.873987 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 6ca5212b1a1743f2910407d7b8ba7aaf Jul 28 04:02:11.873987 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1523098003 Jul 28 04:02:11.873987 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:02:11.873987 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:02:11.875344 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6ca5212b1a1743f2910407d7b8ba7aaf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ca5212b1a1743f2910407d7b8ba7aaf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ca5212b1a1743f2910407d7b8ba7aaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6ca5212b1a1743f2910407d7b8ba7aaf"}]}] Jul 28 04:02:11.875344 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1523098003 Jul 28 04:02:11.875344 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 6ca5212b1a1743f2910407d7b8ba7aaf Jul 28 04:02:11.875344 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1523098003 Jul 28 04:02:11.875344 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-ServerRescueNegativeTestJSON-1523098003-project Jul 28 04:02:11.875344 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:02:11.875344 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:02:11.875344 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: 72dbbd19e4454bee84fe5bc797497bd0 Jul 28 04:02:11.875344 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1523098003-project Jul 28 04:02:11.875344 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Jul 28 04:02:11.875344 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {"volumeAttachment": {"volumeId": "6c0ab361-373b-4723-bce3-e251dcd1073f"}} Jul 28 04:02:11.875344 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:02:11.876672 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Cannot 'attach_volume' instance 54fdcaaa-031e-4509-b8a7-6b284460c7d2 while it is in vm_state rescued Jul 28 04:02:11.876672 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'server_id': '54fdcaaa-031e-4509-b8a7-6b284460c7d2', 'body': {'volumeAttachment': {'volumeId': '6c0ab361-373b-4723-bce3-e251dcd1073f'}}} Jul 28 04:02:11.876672 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:02:11.876672 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:02:11.876672 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 04:02:11.876672 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 04:02:11.876672 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 04:02:11.876672 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 04:02:11.876672 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 04:02:11.876672 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 04:02:11.876672 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 54fdcaaa-031e-4509-b8a7-6b284460c7d2 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 28 04:02:11.876672 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:02:11.876672 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:02:11.876672 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:02:11.876672 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:02:11.876672 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:02:11.876672 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:02:11.876672 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:02:11.876672 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:02:11.878063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:02:11.878063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:02:11.878063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:02:11.878063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:02:11.878063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:02:11.878063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:02:11.878063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:02:11.878063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:02:11.878063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 28 04:02:11.878063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 04:02:11.878063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 04:02:11.878063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 04:02:11.878063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 54fdcaaa-031e-4509-b8a7-6b284460c7d2 while it is in vm_state rescued Jul 28 04:02:11.878063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:02:11.878063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:02:11.878063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:02:11.878063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:02:11.878063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:02:11.878063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:02:11.879525 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:02:11.879525 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:02:11.879525 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 54fdcaaa-031e-4509-b8a7-6b284460c7d2 while it is in vm_state rescued Jul 28 04:02:11.879525 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:02:11.879525 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-85c437ba-5b20-4f77-91d1-f45b9add6259 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Returning 409 to user: Cannot 'attach_volume' instance 54fdcaaa-031e-4509-b8a7-6b284460c7d2 while it is in vm_state rescued {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:02:11.883472 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-85c437ba-5b20-4f77-91d1-f45b9add6259 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "POST /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.083169 Jul 28 04:02:11.884539 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 221/396] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Jul 28 04:02:11 2022] POST /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2/os-volume_attachments => generated 152 bytes in 85 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 04:02:11.893121 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8db2dddb-1ede-4871-bb42-0aee6a4c695e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:11.901645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8db2dddb-1ede-4871-bb42-0aee6a4c695e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:11.902316 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8db2dddb-1ede-4871-bb42-0aee6a4c695e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:11.970860 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8db2dddb-1ede-4871-bb42-0aee6a4c695e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Going to try to start instance {{(pid=118187) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 04:02:12.019408 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8db2dddb-1ede-4871-bb42-0aee6a4c695e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "POST /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475/action" status: 202 len: 0 microversion: 2.1 time: 0.133057 Jul 28 04:02:12.022830 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 222/397] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Jul 28 04:02:11 2022] POST /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:02:12.026870 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5128c65a-88fc-40c2-a997-85076512f97b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:12.027145 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5128c65a-88fc-40c2-a997-85076512f97b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:12.037252 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5128c65a-88fc-40c2-a997-85076512f97b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:12.037997 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5128c65a-88fc-40c2-a997-85076512f97b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:12.038959 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5128c65a-88fc-40c2-a997-85076512f97b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:12.039419 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5128c65a-88fc-40c2-a997-85076512f97b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:12.134873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5128c65a-88fc-40c2-a997-85076512f97b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "POST /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2/action" status: 202 len: 0 microversion: 2.1 time: 0.113327 Jul 28 04:02:12.149224 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 223/398] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Jul 28 04:02:12 2022] POST /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:02:12.158156 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-19c5468d-6d20-405e-a20f-c0038132b008 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:12.159682 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-19c5468d-6d20-405e-a20f-c0038132b008 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:12.167162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-19c5468d-6d20-405e-a20f-c0038132b008 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:12.168243 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-19c5468d-6d20-405e-a20f-c0038132b008 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:12.169037 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-19c5468d-6d20-405e-a20f-c0038132b008 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:12.169473 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-19c5468d-6d20-405e-a20f-c0038132b008 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:12.390242 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-19c5468d-6d20-405e-a20f-c0038132b008 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:12.405127 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-19c5468d-6d20-405e-a20f-c0038132b008 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1708 microversion: 2.1 time: 0.264722 Jul 28 04:02:12.406254 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 224/399] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:12 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1708 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:12.412460 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7d821bd1-b948-408e-84ed-a220cad0052a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:12.413646 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7d821bd1-b948-408e-84ed-a220cad0052a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:12.425391 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7d821bd1-b948-408e-84ed-a220cad0052a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:12.426106 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7d821bd1-b948-408e-84ed-a220cad0052a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:12.427567 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7d821bd1-b948-408e-84ed-a220cad0052a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:12.428236 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7d821bd1-b948-408e-84ed-a220cad0052a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:12.650093 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7d821bd1-b948-408e-84ed-a220cad0052a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:12.660097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7d821bd1-b948-408e-84ed-a220cad0052a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1510 microversion: 2.1 time: 0.251759 Jul 28 04:02:12.663505 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 225/400] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:12 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1510 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:13.431886 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-dc19f95c-7ecc-421b-b17a-8eb515fc707d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:13.446813 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-dc19f95c-7ecc-421b-b17a-8eb515fc707d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:13.461918 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dc19f95c-7ecc-421b-b17a-8eb515fc707d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:13.463676 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dc19f95c-7ecc-421b-b17a-8eb515fc707d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:13.464067 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dc19f95c-7ecc-421b-b17a-8eb515fc707d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:13.464621 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dc19f95c-7ecc-421b-b17a-8eb515fc707d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:13.665584 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-dc19f95c-7ecc-421b-b17a-8eb515fc707d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:13.673976 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-dc19f95c-7ecc-421b-b17a-8eb515fc707d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1708 microversion: 2.1 time: 0.247187 Jul 28 04:02:13.675141 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 226/401] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:13 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1708 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:13.687379 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e1eeb8f9-d42e-4440-9c96-13f54ebf3895 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:13.689195 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e1eeb8f9-d42e-4440-9c96-13f54ebf3895 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:13.696170 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e1eeb8f9-d42e-4440-9c96-13f54ebf3895 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:13.697249 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e1eeb8f9-d42e-4440-9c96-13f54ebf3895 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:13.699382 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e1eeb8f9-d42e-4440-9c96-13f54ebf3895 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:13.708913 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e1eeb8f9-d42e-4440-9c96-13f54ebf3895 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:13.872178 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e1eeb8f9-d42e-4440-9c96-13f54ebf3895 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:13.890279 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e1eeb8f9-d42e-4440-9c96-13f54ebf3895 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1510 microversion: 2.1 time: 0.206478 Jul 28 04:02:13.900440 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 227/402] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:13 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1510 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:14.041581 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b298b4bd-7c97-4e19-b76d-596c77e86089 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:14.042075 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b298b4bd-7c97-4e19-b76d-596c77e86089 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:14.048582 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b298b4bd-7c97-4e19-b76d-596c77e86089 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:14.049380 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b298b4bd-7c97-4e19-b76d-596c77e86089 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:14.050480 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b298b4bd-7c97-4e19-b76d-596c77e86089 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:14.051098 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b298b4bd-7c97-4e19-b76d-596c77e86089 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:14.192923 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.objects.instance [None req-b298b4bd-7c97-4e19-b76d-596c77e86089 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lazy-loading 'services' on Instance uuid 29e220bf-3787-43ae-9151-849afd7d4f91 {{(pid=118187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:02:14.292827 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=4 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:14.320615 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b298b4bd-7c97-4e19-b76d-596c77e86089 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "DELETE /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91/os-volume_attachments/78a9d74b-dfe6-49bd-a9f5-612fd320fb05" status: 202 len: 0 microversion: 2.1 time: 0.283028 Jul 28 04:02:14.321358 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 228/403] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Jul 28 04:02:14 2022] DELETE /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91/os-volume_attachments/78a9d74b-dfe6-49bd-a9f5-612fd320fb05 => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:02:14.697319 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-24d370bc-a7d2-4dd4-8ce0-52059ff400a2 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:14.698023 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-24d370bc-a7d2-4dd4-8ce0-52059ff400a2 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:14.704778 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-24d370bc-a7d2-4dd4-8ce0-52059ff400a2 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:14.705347 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-24d370bc-a7d2-4dd4-8ce0-52059ff400a2 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:14.706147 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-24d370bc-a7d2-4dd4-8ce0-52059ff400a2 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:14.706603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-24d370bc-a7d2-4dd4-8ce0-52059ff400a2 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:14.866520 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-24d370bc-a7d2-4dd4-8ce0-52059ff400a2 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:14.875525 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-24d370bc-a7d2-4dd4-8ce0-52059ff400a2 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1708 microversion: 2.1 time: 0.182578 Jul 28 04:02:14.876772 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 229/404] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:14 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1708 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:14.914377 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-0244b34b-a9cf-425f-aa82-3a33585bfa3d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:14.915229 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-0244b34b-a9cf-425f-aa82-3a33585bfa3d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:14.921692 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0244b34b-a9cf-425f-aa82-3a33585bfa3d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:14.922319 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0244b34b-a9cf-425f-aa82-3a33585bfa3d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:14.923224 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0244b34b-a9cf-425f-aa82-3a33585bfa3d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:14.923758 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0244b34b-a9cf-425f-aa82-3a33585bfa3d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:15.082440 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-0244b34b-a9cf-425f-aa82-3a33585bfa3d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:15.091330 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-0244b34b-a9cf-425f-aa82-3a33585bfa3d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1510 microversion: 2.1 time: 0.181585 Jul 28 04:02:15.105723 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 230/405] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:14 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1510 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:15.729105 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=49 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:15.897325 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-56aab3ae-e06a-4b2b-812c-e34cb510cb67 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:15.898014 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-56aab3ae-e06a-4b2b-812c-e34cb510cb67 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:15.904405 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-56aab3ae-e06a-4b2b-812c-e34cb510cb67 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:15.904922 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-56aab3ae-e06a-4b2b-812c-e34cb510cb67 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:15.906015 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-56aab3ae-e06a-4b2b-812c-e34cb510cb67 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:15.906454 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-56aab3ae-e06a-4b2b-812c-e34cb510cb67 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:15.947689 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=5 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:16.077464 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-56aab3ae-e06a-4b2b-812c-e34cb510cb67 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:16.087780 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-56aab3ae-e06a-4b2b-812c-e34cb510cb67 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1712 microversion: 2.1 time: 0.194247 Jul 28 04:02:16.088438 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 231/406] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:15 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1712 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:16.113355 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3bbacf8e-bf57-4983-b990-eb85f9559f5c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:16.114149 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3bbacf8e-bf57-4983-b990-eb85f9559f5c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:16.120225 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3bbacf8e-bf57-4983-b990-eb85f9559f5c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:16.120678 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3bbacf8e-bf57-4983-b990-eb85f9559f5c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:16.121445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3bbacf8e-bf57-4983-b990-eb85f9559f5c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:16.121887 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3bbacf8e-bf57-4983-b990-eb85f9559f5c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:16.269143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3bbacf8e-bf57-4983-b990-eb85f9559f5c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:16.276693 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3bbacf8e-bf57-4983-b990-eb85f9559f5c tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1516 microversion: 2.1 time: 0.167095 Jul 28 04:02:16.277272 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 232/407] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:16 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1516 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:17.600605 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c9f59bad-d7ae-443d-ab7b-695ed5ddbf63 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:17.601209 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c9f59bad-d7ae-443d-ab7b-695ed5ddbf63 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:17.607635 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c9f59bad-d7ae-443d-ab7b-695ed5ddbf63 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:17.608096 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c9f59bad-d7ae-443d-ab7b-695ed5ddbf63 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:17.608928 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c9f59bad-d7ae-443d-ab7b-695ed5ddbf63 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:17.609391 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c9f59bad-d7ae-443d-ab7b-695ed5ddbf63 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:17.629421 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:17.639029 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c9f59bad-d7ae-443d-ab7b-695ed5ddbf63 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Going to try to terminate instance {{(pid=118187) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:02:17.729907 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c9f59bad-d7ae-443d-ab7b-695ed5ddbf63 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "DELETE /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 204 len: 0 microversion: 2.1 time: 0.132948 Jul 28 04:02:17.734050 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 233/408] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:02:17 2022] DELETE /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:02:17.740455 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c28cae40-bc4d-4299-8be5-ad8d433e2ff7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Action: 'create', calling method: .version_select at 0x7fa6ee2599d0>, body: {"keypair": {"name": "tempest-keypair-369653909", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLwxnip0IKgExqEJaQSZeFVpDhP81C8YZgywUc/5ZcdU724NJy+x8zZ3vj8JJuTp+afPDJdluC7Yx3Hga9oIsbjWFpX5f7L9KWAJ2tFEOHwWtx9EYsBIgAcZX84zj4hN7Q=="}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:17.757832 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-c28cae40-bc4d-4299-8be5-ad8d433e2ff7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Getting quotas for project 6ca5212b1a1743f2910407d7b8ba7aaf. Resources: {'key_pairs'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:02:17.761841 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-c28cae40-bc4d-4299-8be5-ad8d433e2ff7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Getting quotas for user 72dbbd19e4454bee84fe5bc797497bd0 and project 6ca5212b1a1743f2910407d7b8ba7aaf. Resources: {'key_pairs'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:02:17.789142 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c28cae40-bc4d-4299-8be5-ad8d433e2ff7 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053485 Jul 28 04:02:17.789829 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 234/409] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 04:02:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:02:17.795166 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ca3b96cd-baff-4e83-995c-0381d15cdc96 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:17.796031 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ca3b96cd-baff-4e83-995c-0381d15cdc96 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:17.803981 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ca3b96cd-baff-4e83-995c-0381d15cdc96 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:17.804564 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ca3b96cd-baff-4e83-995c-0381d15cdc96 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:17.805253 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ca3b96cd-baff-4e83-995c-0381d15cdc96 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:17.805693 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ca3b96cd-baff-4e83-995c-0381d15cdc96 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:17.973264 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ca3b96cd-baff-4e83-995c-0381d15cdc96 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:17.982979 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ca3b96cd-baff-4e83-995c-0381d15cdc96 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1512 microversion: 2.1 time: 0.191840 Jul 28 04:02:17.983880 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 235/410] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:17 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1512 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:19.005784 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-0ef9541c-2d4d-47cb-8630-27368d1e78a6 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:19.006541 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-0ef9541c-2d4d-47cb-8630-27368d1e78a6 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:19.018589 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0ef9541c-2d4d-47cb-8630-27368d1e78a6 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:19.019389 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0ef9541c-2d4d-47cb-8630-27368d1e78a6 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:19.020424 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0ef9541c-2d4d-47cb-8630-27368d1e78a6 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:19.021019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0ef9541c-2d4d-47cb-8630-27368d1e78a6 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:19.284960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-0ef9541c-2d4d-47cb-8630-27368d1e78a6 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:19.296718 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-0ef9541c-2d4d-47cb-8630-27368d1e78a6 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 200 len: 1512 microversion: 2.1 time: 0.294450 Jul 28 04:02:19.300219 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 236/411] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:18 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 1512 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:19.733158 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-86aa09bf-28c5-45ba-b572-3304ba012bbe tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2013151043", "imageRef": "a0eec51c-83e9-420b-bcb9-20fe8dcf5321", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "34f2eea8-1bb5-4a42-ad93-e6506b454025"}], "security_groups": [{"name": "tempest-securitygroup--1067221291"}], "key_name": "tempest-keypair-369653909", "user_data": "}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:20.546956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.network.neutron [None req-86aa09bf-28c5-45ba-b572-3304ba012bbe tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] validate_networks() for [('34f2eea8-1bb5-4a42-ad93-e6506b454025', None, None, None, None, None)] {{(pid=118187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:02:20.563735 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.network.neutron [None req-6857245f-fd36-4a2a-a6c0-d0e05826474e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] validate_networks() for [('21c60ecd-c113-4857-a1b5-c85ec6a7053f', None, None, None, None, None)] {{(pid=118186) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:02:21.114761 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-86aa09bf-28c5-45ba-b572-3304ba012bbe tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Flavor limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:02:21.115299 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-86aa09bf-28c5-45ba-b572-3304ba012bbe tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Image limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:02:21.116239 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-86aa09bf-28c5-45ba-b572-3304ba012bbe tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Flavor pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:02:21.116734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-86aa09bf-28c5-45ba-b572-3304ba012bbe tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Image pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:02:21.117227 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-86aa09bf-28c5-45ba-b572-3304ba012bbe tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:02:21.131890 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-86aa09bf-28c5-45ba-b572-3304ba012bbe tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:21.132692 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-86aa09bf-28c5-45ba-b572-3304ba012bbe tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:21.133864 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-86aa09bf-28c5-45ba-b572-3304ba012bbe tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:21.134283 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-86aa09bf-28c5-45ba-b572-3304ba012bbe tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:21.154807 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-86aa09bf-28c5-45ba-b572-3304ba012bbe tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Getting quotas for project 6ca5212b1a1743f2910407d7b8ba7aaf. Resources: {'instances', 'cores', 'ram'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:02:21.157837 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:21.161460 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-86aa09bf-28c5-45ba-b572-3304ba012bbe tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Getting quotas for user 72dbbd19e4454bee84fe5bc797497bd0 and project 6ca5212b1a1743f2910407d7b8ba7aaf. Resources: {'instances', 'cores', 'ram'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:02:21.178817 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-86aa09bf-28c5-45ba-b572-3304ba012bbe tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Going to run 1 instances... {{(pid=118187) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:02:21.181605 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-86aa09bf-28c5-45ba-b572-3304ba012bbe tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0eec51c-83e9-420b-bcb9-20fe8dcf5321',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:02:21.265181 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-86aa09bf-28c5-45ba-b572-3304ba012bbe tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.536038 Jul 28 04:02:21.265800 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 237/412] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 04:02:19 2022] POST /compute/v2.1/servers => generated 409 bytes in 1537 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:02:21.272483 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a9b1457d-3657-4527-b07d-5badd3152f35 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:21.283376 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a9b1457d-3657-4527-b07d-5badd3152f35 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 29e220bf-3787-43ae-9151-849afd7d4f91] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:21.288535 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a9b1457d-3657-4527-b07d-5badd3152f35 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:21.288804 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a9b1457d-3657-4527-b07d-5badd3152f35 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:21.289536 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a9b1457d-3657-4527-b07d-5badd3152f35 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:21.289998 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a9b1457d-3657-4527-b07d-5badd3152f35 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:21.306411 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-a9b1457d-3657-4527-b07d-5badd3152f35 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] HTTP exception thrown: Instance 29e220bf-3787-43ae-9151-849afd7d4f91 could not be found. Jul 28 04:02:21.308151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a9b1457d-3657-4527-b07d-5badd3152f35 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Request method failure captured: Jul 28 04:02:21.308151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 HTTP/1.1 Jul 28 04:02:21.308151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:02:21.308151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:02:21.308151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:02:21.308151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:02:21.308151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:02:21.308151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:02:21.308151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:02:21.308151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:02:21.308151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gnlHQ53KXWbcHoQWI3iPZe4JPyp0avePqbrDsTc3tTM3JDrpDvRxZxxbxLKiOpy_g5HNV24G3vLySgW_7n5kmhrCq8_k0obWtLR33kxdDa9vIphA4JEejoW-1Y3NL6jVku_IdCPlE8nqhvyKCx-w4X3798LZWfGdnnsjptbcjKtvZY Jul 28 04:02:21.308151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:02:21.308151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:02:21.308151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:02:21.308151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:02:21.308151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:02:21.308151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:02:21.308151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 3e4289e377d24036b968d0ae71c61dcc Jul 28 04:02:21.308151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1815150758 Jul 28 04:02:21.308151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:02:21.308151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:02:21.309768 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3e4289e377d24036b968d0ae71c61dcc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3e4289e377d24036b968d0ae71c61dcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3e4289e377d24036b968d0ae71c61dcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3e4289e377d24036b968d0ae71c61dcc"}]}] Jul 28 04:02:21.309768 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-VolumesSnapshotTestJSON-1815150758 Jul 28 04:02:21.309768 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 3e4289e377d24036b968d0ae71c61dcc Jul 28 04:02:21.309768 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1815150758 Jul 28 04:02:21.309768 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-VolumesSnapshotTestJSON-1815150758-project Jul 28 04:02:21.309768 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:02:21.309768 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:02:21.309768 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: 518ad5eb820e44aa9689215e6038a521 Jul 28 04:02:21.309768 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-VolumesSnapshotTestJSON-1815150758-project Jul 28 04:02:21.309768 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:02:21.309768 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Instance 29e220bf-3787-43ae-9151-849afd7d4f91 could not be found. Jul 28 04:02:21.309768 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': '29e220bf-3787-43ae-9151-849afd7d4f91'} Jul 28 04:02:21.310678 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:02:21.310678 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:02:21.310678 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:02:21.310678 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:02:21.310678 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:02:21.310678 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:02:21.310678 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:02:21.310678 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:02:21.310678 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:02:21.310678 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:02:21.310678 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 29e220bf-3787-43ae-9151-849afd7d4f91 could not be found. Jul 28 04:02:21.310678 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:02:21.310678 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:02:21.310678 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:02:21.310678 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:02:21.310678 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:02:21.310678 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:02:21.310678 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:02:21.310678 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:02:21.310678 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:02:21.311985 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:02:21.311985 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:02:21.311985 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:02:21.311985 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:02:21.311985 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:02:21.311985 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:02:21.311985 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:02:21.311985 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 29e220bf-3787-43ae-9151-849afd7d4f91 could not be found. Jul 28 04:02:21.311985 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:02:21.311985 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:02:21.311985 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:02:21.311985 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:02:21.311985 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:02:21.311985 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:02:21.311985 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:02:21.311985 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:02:21.311985 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 29e220bf-3787-43ae-9151-849afd7d4f91 could not be found. Jul 28 04:02:21.311985 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:02:21.313236 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a9b1457d-3657-4527-b07d-5badd3152f35 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Returning 404 to user: Instance 29e220bf-3787-43ae-9151-849afd7d4f91 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:02:21.313236 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a9b1457d-3657-4527-b07d-5badd3152f35 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91" status: 404 len: 111 microversion: 2.1 time: 0.041536 Jul 28 04:02:21.313236 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 238/413] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:21 2022] GET /compute/v2.1/servers/29e220bf-3787-43ae-9151-849afd7d4f91 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:02:21.315212 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-5f752bf8-9dec-482d-82c3-1290ed2f8584 req-5b94e673-2120-4751-896a-1f45a086386c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "29e220bf-3787-43ae-9151-849afd7d4f91", "name": "network-vif-deleted", "tag": "ff3a6072-93da-4605-92c6-29a2c45cb25c"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:21.339434 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-5f752bf8-9dec-482d-82c3-1290ed2f8584 req-5b94e673-2120-4751-896a-1f45a086386c service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:21.340244 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-5f752bf8-9dec-482d-82c3-1290ed2f8584 req-5b94e673-2120-4751-896a-1f45a086386c service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:21.355508 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-5f752bf8-9dec-482d-82c3-1290ed2f8584 req-5b94e673-2120-4751-896a-1f45a086386c service nova] Creating event network-vif-deleted:ff3a6072-93da-4605-92c6-29a2c45cb25c for instance 29e220bf-3787-43ae-9151-849afd7d4f91 on hv-cinder-79987 Jul 28 04:02:21.361587 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-6857245f-fd36-4a2a-a6c0-d0e05826474e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Flavor limits 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:02:21.362016 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-6857245f-fd36-4a2a-a6c0-d0e05826474e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Image limits 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:02:21.362517 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-6857245f-fd36-4a2a-a6c0-d0e05826474e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Flavor pref 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:02:21.363819 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-6857245f-fd36-4a2a-a6c0-d0e05826474e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Image pref 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:02:21.363819 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-6857245f-fd36-4a2a-a6c0-d0e05826474e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:02:21.367223 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-5f752bf8-9dec-482d-82c3-1290ed2f8584 req-5b94e673-2120-4751-896a-1f45a086386c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054998 Jul 28 04:02:21.367790 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 239/414] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:02:21.376288 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2c118cf9-b92d-4a19-8b83-27c239570c78 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:21.377399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-2c118cf9-b92d-4a19-8b83-27c239570c78 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:21.387995 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6857245f-fd36-4a2a-a6c0-d0e05826474e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:21.387995 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6857245f-fd36-4a2a-a6c0-d0e05826474e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:21.387995 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6857245f-fd36-4a2a-a6c0-d0e05826474e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:21.387995 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6857245f-fd36-4a2a-a6c0-d0e05826474e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:21.432150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-6857245f-fd36-4a2a-a6c0-d0e05826474e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Getting quotas for project 18a927e9f5da42d7b34752c8b2db211a. Resources: {'instances', 'cores', 'ram'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:02:21.442079 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-6857245f-fd36-4a2a-a6c0-d0e05826474e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Getting quotas for user c3308761e9d2495e95e127bbc7b9c5e2 and project 18a927e9f5da42d7b34752c8b2db211a. Resources: {'instances', 'cores', 'ram'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:02:21.473365 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-2c118cf9-b92d-4a19-8b83-27c239570c78 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:21.476633 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-6857245f-fd36-4a2a-a6c0-d0e05826474e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Going to run 1 instances... {{(pid=118186) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:02:21.480588 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-6857245f-fd36-4a2a-a6c0-d0e05826474e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0eec51c-83e9-420b-bcb9-20fe8dcf5321',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:02:21.490262 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-2c118cf9-b92d-4a19-8b83-27c239570c78 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1245 microversion: 2.1 time: 0.120918 Jul 28 04:02:21.491080 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 240/415] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:21 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1245 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:21.573153 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-6857245f-fd36-4a2a-a6c0-d0e05826474e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 15.639965 Jul 28 04:02:21.574932 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 176/416] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 04:02:05 2022] POST /compute/v2.1/servers => generated 401 bytes in 15643 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:02:21.590735 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-052aec67-e4ec-4bc5-ac1e-fbf27a0ecd74 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:21.592225 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-052aec67-e4ec-4bc5-ac1e-fbf27a0ecd74 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:21.687467 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-052aec67-e4ec-4bc5-ac1e-fbf27a0ecd74 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:21.697191 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-052aec67-e4ec-4bc5-ac1e-fbf27a0ecd74 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 200 len: 1242 microversion: 2.1 time: 0.110565 Jul 28 04:02:21.707135 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 241/417] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:21 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 1242 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:22.512084 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c6cf880a-0f8c-4dc6-97b9-9e5fbc946f20 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:22.512704 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c6cf880a-0f8c-4dc6-97b9-9e5fbc946f20 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:22.520581 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c6cf880a-0f8c-4dc6-97b9-9e5fbc946f20 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:22.521281 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c6cf880a-0f8c-4dc6-97b9-9e5fbc946f20 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:22.522120 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c6cf880a-0f8c-4dc6-97b9-9e5fbc946f20 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:22.522566 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c6cf880a-0f8c-4dc6-97b9-9e5fbc946f20 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:22.586897 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-c6cf880a-0f8c-4dc6-97b9-9e5fbc946f20 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:22.594313 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-c6cf880a-0f8c-4dc6-97b9-9e5fbc946f20 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1241 microversion: 2.1 time: 0.086567 Jul 28 04:02:22.595237 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 177/418] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:22 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1241 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:22.731180 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7a376e10-ab97-49b1-bd5d-4281ec87a6fa tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:22.731792 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7a376e10-ab97-49b1-bd5d-4281ec87a6fa tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:22.738801 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7a376e10-ab97-49b1-bd5d-4281ec87a6fa tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:22.739262 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7a376e10-ab97-49b1-bd5d-4281ec87a6fa tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:22.743037 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7a376e10-ab97-49b1-bd5d-4281ec87a6fa tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:22.743037 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7a376e10-ab97-49b1-bd5d-4281ec87a6fa tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:22.802035 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7a376e10-ab97-49b1-bd5d-4281ec87a6fa tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:22.809465 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7a376e10-ab97-49b1-bd5d-4281ec87a6fa tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 200 len: 1246 microversion: 2.1 time: 0.082107 Jul 28 04:02:22.810025 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 242/419] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:22 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:23.616233 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-6e6d6f26-dc6c-4778-bfc9-de07f871619e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:23.616839 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-6e6d6f26-dc6c-4778-bfc9-de07f871619e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:23.623279 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6e6d6f26-dc6c-4778-bfc9-de07f871619e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:23.623722 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6e6d6f26-dc6c-4778-bfc9-de07f871619e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:23.624470 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6e6d6f26-dc6c-4778-bfc9-de07f871619e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:23.624898 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6e6d6f26-dc6c-4778-bfc9-de07f871619e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:23.690978 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-6e6d6f26-dc6c-4778-bfc9-de07f871619e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:23.698372 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-6e6d6f26-dc6c-4778-bfc9-de07f871619e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1241 microversion: 2.1 time: 0.085962 Jul 28 04:02:23.698982 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 178/420] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:23 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1241 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:23.831262 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-501eab7f-cfa3-40f9-b90b-abf7397d0bab tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:23.831900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-501eab7f-cfa3-40f9-b90b-abf7397d0bab tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:23.838161 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-501eab7f-cfa3-40f9-b90b-abf7397d0bab tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:23.838625 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-501eab7f-cfa3-40f9-b90b-abf7397d0bab tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:23.839439 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-501eab7f-cfa3-40f9-b90b-abf7397d0bab tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:23.839886 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-501eab7f-cfa3-40f9-b90b-abf7397d0bab tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:23.908783 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-501eab7f-cfa3-40f9-b90b-abf7397d0bab tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:23.916529 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-501eab7f-cfa3-40f9-b90b-abf7397d0bab tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 200 len: 1246 microversion: 2.1 time: 0.089568 Jul 28 04:02:23.917126 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 243/421] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:23 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:24.719770 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-5dfcb2b8-ef01-4ef4-b46d-aae7c8eb4de5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:24.720385 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-5dfcb2b8-ef01-4ef4-b46d-aae7c8eb4de5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:24.726936 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5dfcb2b8-ef01-4ef4-b46d-aae7c8eb4de5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:24.727386 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5dfcb2b8-ef01-4ef4-b46d-aae7c8eb4de5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:24.728142 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5dfcb2b8-ef01-4ef4-b46d-aae7c8eb4de5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:24.728575 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5dfcb2b8-ef01-4ef4-b46d-aae7c8eb4de5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:24.792851 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-5dfcb2b8-ef01-4ef4-b46d-aae7c8eb4de5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:24.800890 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-5dfcb2b8-ef01-4ef4-b46d-aae7c8eb4de5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1241 microversion: 2.1 time: 0.085027 Jul 28 04:02:24.801441 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 179/422] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:24 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1241 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:24.937560 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-43f359cd-e5d9-413a-93a6-8d321252fa17 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:24.938175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-43f359cd-e5d9-413a-93a6-8d321252fa17 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:24.944971 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-43f359cd-e5d9-413a-93a6-8d321252fa17 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:24.945432 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-43f359cd-e5d9-413a-93a6-8d321252fa17 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:24.946246 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-43f359cd-e5d9-413a-93a6-8d321252fa17 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:24.946773 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-43f359cd-e5d9-413a-93a6-8d321252fa17 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:25.010030 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-43f359cd-e5d9-413a-93a6-8d321252fa17 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:25.017482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-43f359cd-e5d9-413a-93a6-8d321252fa17 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 200 len: 1238 microversion: 2.1 time: 0.083801 Jul 28 04:02:25.018659 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 244/423] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:24 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 1238 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:25.821772 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-01c807bc-fc69-44c1-aa4a-54240ac6c5f6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:25.822365 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-01c807bc-fc69-44c1-aa4a-54240ac6c5f6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:25.837749 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-01c807bc-fc69-44c1-aa4a-54240ac6c5f6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:25.839362 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-01c807bc-fc69-44c1-aa4a-54240ac6c5f6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:25.840688 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-01c807bc-fc69-44c1-aa4a-54240ac6c5f6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:25.841377 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-01c807bc-fc69-44c1-aa4a-54240ac6c5f6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:25.974726 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-01c807bc-fc69-44c1-aa4a-54240ac6c5f6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:25.988385 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-01c807bc-fc69-44c1-aa4a-54240ac6c5f6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1303 microversion: 2.1 time: 0.170664 Jul 28 04:02:25.989795 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 180/424] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:25 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1303 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:26.040412 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-97459477-81f7-4b7c-8dc3-0801085940a9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:26.042147 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-97459477-81f7-4b7c-8dc3-0801085940a9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:26.048927 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-97459477-81f7-4b7c-8dc3-0801085940a9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:26.050119 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-97459477-81f7-4b7c-8dc3-0801085940a9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:26.051088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-97459477-81f7-4b7c-8dc3-0801085940a9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:26.051662 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-97459477-81f7-4b7c-8dc3-0801085940a9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:26.121914 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-97459477-81f7-4b7c-8dc3-0801085940a9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:26.130502 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-97459477-81f7-4b7c-8dc3-0801085940a9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 200 len: 1300 microversion: 2.1 time: 0.094139 Jul 28 04:02:26.131111 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 245/425] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:26 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 1300 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:27.013693 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-bb9aec9a-5295-4b63-8ca6-30dba437bb45 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:27.014388 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-bb9aec9a-5295-4b63-8ca6-30dba437bb45 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:27.029846 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bb9aec9a-5295-4b63-8ca6-30dba437bb45 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:27.032399 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bb9aec9a-5295-4b63-8ca6-30dba437bb45 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:27.034695 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bb9aec9a-5295-4b63-8ca6-30dba437bb45 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:27.035516 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bb9aec9a-5295-4b63-8ca6-30dba437bb45 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:27.152228 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-917973a5-2676-40f3-9323-92af570baaee tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:27.152845 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-917973a5-2676-40f3-9323-92af570baaee tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:27.165845 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-917973a5-2676-40f3-9323-92af570baaee tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:27.166662 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-917973a5-2676-40f3-9323-92af570baaee tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:27.167631 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-917973a5-2676-40f3-9323-92af570baaee tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:27.168227 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-917973a5-2676-40f3-9323-92af570baaee tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:27.484093 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-917973a5-2676-40f3-9323-92af570baaee tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:27.493273 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-917973a5-2676-40f3-9323-92af570baaee tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 200 len: 1367 microversion: 2.1 time: 0.344849 Jul 28 04:02:27.494260 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 246/426] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:27 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 1367 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:27.610831 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-bb9aec9a-5295-4b63-8ca6-30dba437bb45 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:27.618940 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-bb9aec9a-5295-4b63-8ca6-30dba437bb45 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1371 microversion: 2.1 time: 0.612884 Jul 28 04:02:27.619515 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 181/427] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:27 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1371 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:28.524621 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-26466cb1-fa19-4304-96f7-3a10a14730e2 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:28.525256 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-26466cb1-fa19-4304-96f7-3a10a14730e2 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:28.537037 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-26466cb1-fa19-4304-96f7-3a10a14730e2 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:28.543575 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-26466cb1-fa19-4304-96f7-3a10a14730e2 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:28.544628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-26466cb1-fa19-4304-96f7-3a10a14730e2 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:28.545229 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-26466cb1-fa19-4304-96f7-3a10a14730e2 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:28.643530 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-548edc97-ad07-40a2-b64c-bacf1cd97b76 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:28.651663 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-548edc97-ad07-40a2-b64c-bacf1cd97b76 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:28.659337 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-548edc97-ad07-40a2-b64c-bacf1cd97b76 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:28.660276 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-548edc97-ad07-40a2-b64c-bacf1cd97b76 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:28.661413 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-548edc97-ad07-40a2-b64c-bacf1cd97b76 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:28.662069 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-548edc97-ad07-40a2-b64c-bacf1cd97b76 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:28.826432 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-26466cb1-fa19-4304-96f7-3a10a14730e2 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:28.836975 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-26466cb1-fa19-4304-96f7-3a10a14730e2 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 200 len: 1367 microversion: 2.1 time: 0.321498 Jul 28 04:02:28.837570 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 247/428] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:28 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 1367 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:29.182870 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-548edc97-ad07-40a2-b64c-bacf1cd97b76 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:29.193099 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-548edc97-ad07-40a2-b64c-bacf1cd97b76 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1371 microversion: 2.1 time: 0.554908 Jul 28 04:02:29.203223 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 182/429] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:28 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1371 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:29.288737 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-7a5fba82-e95f-4312-a4c1-6ace1ce84520 req-08495f35-f190-43dc-8821-acf9ed6775bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe24f923-0389-4154-a7bb-062800043d11", "tag": "606d30e1-9cda-4404-8c90-b1f1e3b45f28"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:29.298106 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-7a5fba82-e95f-4312-a4c1-6ace1ce84520 req-08495f35-f190-43dc-8821-acf9ed6775bb service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:29.298565 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-7a5fba82-e95f-4312-a4c1-6ace1ce84520 req-08495f35-f190-43dc-8821-acf9ed6775bb service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:29.315491 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-7a5fba82-e95f-4312-a4c1-6ace1ce84520 req-08495f35-f190-43dc-8821-acf9ed6775bb service nova] Creating event network-changed:606d30e1-9cda-4404-8c90-b1f1e3b45f28 for instance fe24f923-0389-4154-a7bb-062800043d11 on hv-cinder-79987 Jul 28 04:02:29.327854 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-7a5fba82-e95f-4312-a4c1-6ace1ce84520 req-08495f35-f190-43dc-8821-acf9ed6775bb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043223 Jul 28 04:02:29.328342 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 248/430] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:02:29.858912 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-6cc3ead0-80ea-4eef-b605-eb149c64509d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:29.859528 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-6cc3ead0-80ea-4eef-b605-eb149c64509d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:29.867435 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6cc3ead0-80ea-4eef-b605-eb149c64509d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:29.867889 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6cc3ead0-80ea-4eef-b605-eb149c64509d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:29.868659 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6cc3ead0-80ea-4eef-b605-eb149c64509d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:29.869080 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6cc3ead0-80ea-4eef-b605-eb149c64509d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:30.011774 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-6cc3ead0-80ea-4eef-b605-eb149c64509d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:30.020209 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-6cc3ead0-80ea-4eef-b605-eb149c64509d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 200 len: 1367 microversion: 2.1 time: 0.165258 Jul 28 04:02:30.020857 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 183/431] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:29 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:30.216000 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6d51e95f-6507-491d-860c-352fbffbc816 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:30.216777 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6d51e95f-6507-491d-860c-352fbffbc816 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:30.225941 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6d51e95f-6507-491d-860c-352fbffbc816 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:30.226399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6d51e95f-6507-491d-860c-352fbffbc816 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:30.227444 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6d51e95f-6507-491d-860c-352fbffbc816 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:30.227890 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6d51e95f-6507-491d-860c-352fbffbc816 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:30.372939 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6d51e95f-6507-491d-860c-352fbffbc816 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:30.380407 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6d51e95f-6507-491d-860c-352fbffbc816 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1371 microversion: 2.1 time: 0.169323 Jul 28 04:02:30.380965 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 249/432] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:30 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:31.041026 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a495c001-b5ef-4721-8f06-8dc2c5d6e3e8 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:31.041643 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-a495c001-b5ef-4721-8f06-8dc2c5d6e3e8 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:31.048218 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a495c001-b5ef-4721-8f06-8dc2c5d6e3e8 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:31.048667 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a495c001-b5ef-4721-8f06-8dc2c5d6e3e8 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:31.049457 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a495c001-b5ef-4721-8f06-8dc2c5d6e3e8 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:31.049896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a495c001-b5ef-4721-8f06-8dc2c5d6e3e8 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:31.259225 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-a495c001-b5ef-4721-8f06-8dc2c5d6e3e8 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:31.267388 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-a495c001-b5ef-4721-8f06-8dc2c5d6e3e8 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 200 len: 1367 microversion: 2.1 time: 0.230510 Jul 28 04:02:31.282745 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 184/433] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:31 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:31.367779 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-bbe76288-5c57-4859-b40a-8204567784fc req-4c9d5441-3820-4ce5-9b20-ec7c28d40829 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa036966-7c31-4a36-97fd-4d3eadd09fb0", "tag": "df6e2763-2336-4f96-9cf5-6bda9111085f"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:31.373489 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:31.380473 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-bbe76288-5c57-4859-b40a-8204567784fc req-4c9d5441-3820-4ce5-9b20-ec7c28d40829 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:31.381213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-bbe76288-5c57-4859-b40a-8204567784fc req-4c9d5441-3820-4ce5-9b20-ec7c28d40829 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:31.394979 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-bbe76288-5c57-4859-b40a-8204567784fc req-4c9d5441-3820-4ce5-9b20-ec7c28d40829 service nova] Creating event network-changed:df6e2763-2336-4f96-9cf5-6bda9111085f for instance fa036966-7c31-4a36-97fd-4d3eadd09fb0 on hv-cinder-79987 Jul 28 04:02:31.401511 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-78e15b29-166a-4780-88ef-3eaeb892ee26 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:31.403321 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-78e15b29-166a-4780-88ef-3eaeb892ee26 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:31.406019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-bbe76288-5c57-4859-b40a-8204567784fc req-4c9d5441-3820-4ce5-9b20-ec7c28d40829 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042236 Jul 28 04:02:31.407211 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 250/434] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:02:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:02:31.414993 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell0:SELECT=2 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:31.416817 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-78e15b29-166a-4780-88ef-3eaeb892ee26 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:31.418593 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-78e15b29-166a-4780-88ef-3eaeb892ee26 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:31.419684 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-78e15b29-166a-4780-88ef-3eaeb892ee26 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:31.420462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-78e15b29-166a-4780-88ef-3eaeb892ee26 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:31.459620 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell0:SELECT=6 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:31.743026 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a91b816e-71dd-4135-8b18-f487d185549a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-611799041", "imageRef": "a0eec51c-83e9-420b-bcb9-20fe8dcf5321", "flavorRef": "452", "networks": [{"uuid": "7ddbd13e-785d-4f40-a868-20c0f3f5c79e"}]}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:31.753384 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=14 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:31.759646 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-78e15b29-166a-4780-88ef-3eaeb892ee26 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:31.775110 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-78e15b29-166a-4780-88ef-3eaeb892ee26 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1371 microversion: 2.1 time: 0.377532 Jul 28 04:02:31.776414 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 185/435] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:31 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1371 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:32.290325 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-95999304-1c11-4a5e-bdd4-45f532cd60a4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:32.290962 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-95999304-1c11-4a5e-bdd4-45f532cd60a4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:32.297492 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-95999304-1c11-4a5e-bdd4-45f532cd60a4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:32.297949 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-95999304-1c11-4a5e-bdd4-45f532cd60a4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:32.298719 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-95999304-1c11-4a5e-bdd4-45f532cd60a4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:32.299247 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-95999304-1c11-4a5e-bdd4-45f532cd60a4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:32.449092 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-95999304-1c11-4a5e-bdd4-45f532cd60a4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:32.457436 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-95999304-1c11-4a5e-bdd4-45f532cd60a4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 200 len: 1367 microversion: 2.1 time: 0.171265 Jul 28 04:02:32.458019 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 186/436] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:32 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:32.797724 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-f7841769-6304-4b3d-a3a3-bf6fc7fffa66 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:32.798348 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-f7841769-6304-4b3d-a3a3-bf6fc7fffa66 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:32.805222 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f7841769-6304-4b3d-a3a3-bf6fc7fffa66 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:32.805679 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f7841769-6304-4b3d-a3a3-bf6fc7fffa66 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:32.806457 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f7841769-6304-4b3d-a3a3-bf6fc7fffa66 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:32.806924 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f7841769-6304-4b3d-a3a3-bf6fc7fffa66 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:32.941614 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-f7841769-6304-4b3d-a3a3-bf6fc7fffa66 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:32.949064 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-f7841769-6304-4b3d-a3a3-bf6fc7fffa66 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1371 microversion: 2.1 time: 0.155307 Jul 28 04:02:32.949646 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 187/437] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:32 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:33.477677 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-2353527a-c654-4063-8f29-eb4b8da6b826 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:33.478299 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-2353527a-c654-4063-8f29-eb4b8da6b826 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:33.484783 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2353527a-c654-4063-8f29-eb4b8da6b826 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:33.485237 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2353527a-c654-4063-8f29-eb4b8da6b826 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:33.486003 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2353527a-c654-4063-8f29-eb4b8da6b826 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:33.486445 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2353527a-c654-4063-8f29-eb4b8da6b826 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:33.624129 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-2353527a-c654-4063-8f29-eb4b8da6b826 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:33.634602 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-2353527a-c654-4063-8f29-eb4b8da6b826 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 200 len: 1367 microversion: 2.1 time: 0.160704 Jul 28 04:02:33.635221 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 188/438] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:33 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:33.972052 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-924c9f8f-e62a-4e6f-9cc8-9ae90bf87583 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:33.973013 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-924c9f8f-e62a-4e6f-9cc8-9ae90bf87583 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:33.979585 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-924c9f8f-e62a-4e6f-9cc8-9ae90bf87583 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:33.980068 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-924c9f8f-e62a-4e6f-9cc8-9ae90bf87583 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:33.981029 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-924c9f8f-e62a-4e6f-9cc8-9ae90bf87583 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:33.981467 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-924c9f8f-e62a-4e6f-9cc8-9ae90bf87583 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:34.173141 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-924c9f8f-e62a-4e6f-9cc8-9ae90bf87583 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:34.181393 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-924c9f8f-e62a-4e6f-9cc8-9ae90bf87583 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1371 microversion: 2.1 time: 0.213840 Jul 28 04:02:34.181977 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 189/439] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:33 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:34.656117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-4a171d84-45fe-47e5-9f09-584ff4fb4b99 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:34.656811 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-4a171d84-45fe-47e5-9f09-584ff4fb4b99 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:34.663634 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4a171d84-45fe-47e5-9f09-584ff4fb4b99 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:34.664076 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4a171d84-45fe-47e5-9f09-584ff4fb4b99 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:34.664908 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4a171d84-45fe-47e5-9f09-584ff4fb4b99 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:34.665339 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4a171d84-45fe-47e5-9f09-584ff4fb4b99 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:34.798378 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-4a171d84-45fe-47e5-9f09-584ff4fb4b99 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:34.806864 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-4a171d84-45fe-47e5-9f09-584ff4fb4b99 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 200 len: 1367 microversion: 2.1 time: 0.154650 Jul 28 04:02:34.807742 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 190/440] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:34 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:35.203186 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-10da8823-9614-4fc8-90e6-25bda5b1f427 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:35.203899 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-10da8823-9614-4fc8-90e6-25bda5b1f427 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:35.210851 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-10da8823-9614-4fc8-90e6-25bda5b1f427 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:35.211300 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-10da8823-9614-4fc8-90e6-25bda5b1f427 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:35.212489 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-10da8823-9614-4fc8-90e6-25bda5b1f427 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:35.212930 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-10da8823-9614-4fc8-90e6-25bda5b1f427 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:35.356319 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-10da8823-9614-4fc8-90e6-25bda5b1f427 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:35.364024 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-10da8823-9614-4fc8-90e6-25bda5b1f427 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1371 microversion: 2.1 time: 0.164643 Jul 28 04:02:35.364689 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 191/441] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:35 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:35.827950 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-1b31098c-fec4-49cd-a418-dc9e9683a8ee tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:35.828744 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-1b31098c-fec4-49cd-a418-dc9e9683a8ee tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:35.836167 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1b31098c-fec4-49cd-a418-dc9e9683a8ee tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:35.836614 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1b31098c-fec4-49cd-a418-dc9e9683a8ee tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:35.837373 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1b31098c-fec4-49cd-a418-dc9e9683a8ee tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:35.837807 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1b31098c-fec4-49cd-a418-dc9e9683a8ee tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:36.085681 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-1b31098c-fec4-49cd-a418-dc9e9683a8ee tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:36.093490 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-1b31098c-fec4-49cd-a418-dc9e9683a8ee tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 200 len: 1367 microversion: 2.1 time: 0.269419 Jul 28 04:02:36.094066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 192/442] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:35 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 1367 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:36.385571 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-3d67f283-03ce-44b6-902a-07d2b18843f4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:36.386108 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-3d67f283-03ce-44b6-902a-07d2b18843f4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:36.392507 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3d67f283-03ce-44b6-902a-07d2b18843f4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:36.393027 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3d67f283-03ce-44b6-902a-07d2b18843f4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:36.393802 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3d67f283-03ce-44b6-902a-07d2b18843f4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:36.394241 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3d67f283-03ce-44b6-902a-07d2b18843f4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:36.398421 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=100 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:36.527918 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-3d67f283-03ce-44b6-902a-07d2b18843f4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:36.536587 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-3d67f283-03ce-44b6-902a-07d2b18843f4 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1371 microversion: 2.1 time: 0.154870 Jul 28 04:02:36.539585 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 193/443] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:36 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:37.113884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-6b846f99-6ebf-4899-a8c3-4deb56276077 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:37.114507 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-6b846f99-6ebf-4899-a8c3-4deb56276077 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:37.122926 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6b846f99-6ebf-4899-a8c3-4deb56276077 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:37.123379 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6b846f99-6ebf-4899-a8c3-4deb56276077 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:37.124543 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6b846f99-6ebf-4899-a8c3-4deb56276077 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:37.124973 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6b846f99-6ebf-4899-a8c3-4deb56276077 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:37.257245 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-6b846f99-6ebf-4899-a8c3-4deb56276077 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:37.264801 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-6b846f99-6ebf-4899-a8c3-4deb56276077 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 200 len: 1367 microversion: 2.1 time: 0.154891 Jul 28 04:02:37.265383 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 194/444] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:37 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:37.557630 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-b4f7b81b-0557-4415-9eba-2801d0170c95 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:37.558246 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-b4f7b81b-0557-4415-9eba-2801d0170c95 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:37.564953 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b4f7b81b-0557-4415-9eba-2801d0170c95 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:37.565421 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b4f7b81b-0557-4415-9eba-2801d0170c95 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:37.566193 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b4f7b81b-0557-4415-9eba-2801d0170c95 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:37.566629 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b4f7b81b-0557-4415-9eba-2801d0170c95 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:37.703806 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-b4f7b81b-0557-4415-9eba-2801d0170c95 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:37.711965 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-b4f7b81b-0557-4415-9eba-2801d0170c95 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1371 microversion: 2.1 time: 0.158326 Jul 28 04:02:37.712525 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 195/445] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:37 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:38.286234 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-947af7bd-f56a-4288-a8de-6476dc9b65ea tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:38.286864 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-947af7bd-f56a-4288-a8de-6476dc9b65ea tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:38.293562 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-947af7bd-f56a-4288-a8de-6476dc9b65ea tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:38.294018 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-947af7bd-f56a-4288-a8de-6476dc9b65ea tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:38.294791 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-947af7bd-f56a-4288-a8de-6476dc9b65ea tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:38.295243 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-947af7bd-f56a-4288-a8de-6476dc9b65ea tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:38.427525 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-947af7bd-f56a-4288-a8de-6476dc9b65ea tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:38.434993 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-947af7bd-f56a-4288-a8de-6476dc9b65ea tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 200 len: 1367 microversion: 2.1 time: 0.153405 Jul 28 04:02:38.435565 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 196/446] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:38 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:38.733698 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-5d531e65-040c-4567-b458-0cf397b25951 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:38.734412 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-5d531e65-040c-4567-b458-0cf397b25951 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:38.740633 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5d531e65-040c-4567-b458-0cf397b25951 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:38.741165 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5d531e65-040c-4567-b458-0cf397b25951 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:38.741990 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5d531e65-040c-4567-b458-0cf397b25951 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:38.742493 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5d531e65-040c-4567-b458-0cf397b25951 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:38.873571 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-5d531e65-040c-4567-b458-0cf397b25951 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:38.882153 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-5d531e65-040c-4567-b458-0cf397b25951 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1371 microversion: 2.1 time: 0.152430 Jul 28 04:02:38.882766 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 197/447] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:38 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:39.456367 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-7718f20e-a13c-4dee-8466-894df20461c7 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:39.457163 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-7718f20e-a13c-4dee-8466-894df20461c7 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:39.463821 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7718f20e-a13c-4dee-8466-894df20461c7 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:39.464515 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7718f20e-a13c-4dee-8466-894df20461c7 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:39.465346 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7718f20e-a13c-4dee-8466-894df20461c7 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:39.465786 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7718f20e-a13c-4dee-8466-894df20461c7 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:39.609225 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-7718f20e-a13c-4dee-8466-894df20461c7 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:39.617574 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-7718f20e-a13c-4dee-8466-894df20461c7 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 200 len: 1367 microversion: 2.1 time: 0.165625 Jul 28 04:02:39.618455 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 198/448] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:39 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:39.780489 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.network.neutron [None req-a91b816e-71dd-4135-8b18-f487d185549a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] validate_networks() for [('7ddbd13e-785d-4f40-a868-20c0f3f5c79e', None, None, None, None, None)] {{(pid=118187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:02:39.903446 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-0d84ef48-3bd7-4769-b19c-9ea8dbb15d89 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:39.904139 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-0d84ef48-3bd7-4769-b19c-9ea8dbb15d89 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:39.911023 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0d84ef48-3bd7-4769-b19c-9ea8dbb15d89 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:39.911549 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0d84ef48-3bd7-4769-b19c-9ea8dbb15d89 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:39.912642 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0d84ef48-3bd7-4769-b19c-9ea8dbb15d89 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:39.913328 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0d84ef48-3bd7-4769-b19c-9ea8dbb15d89 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:40.046960 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-0d84ef48-3bd7-4769-b19c-9ea8dbb15d89 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:40.055037 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-0d84ef48-3bd7-4769-b19c-9ea8dbb15d89 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1371 microversion: 2.1 time: 0.155302 Jul 28 04:02:40.055893 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 199/449] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:39 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1371 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:40.143179 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-a91b816e-71dd-4135-8b18-f487d185549a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Flavor limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:02:40.143604 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-a91b816e-71dd-4135-8b18-f487d185549a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Image limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:02:40.144071 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-a91b816e-71dd-4135-8b18-f487d185549a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Flavor pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:02:40.144476 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-a91b816e-71dd-4135-8b18-f487d185549a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Image pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:02:40.144882 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-a91b816e-71dd-4135-8b18-f487d185549a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:02:40.153537 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a91b816e-71dd-4135-8b18-f487d185549a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:40.154115 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a91b816e-71dd-4135-8b18-f487d185549a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:40.154769 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a91b816e-71dd-4135-8b18-f487d185549a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:40.155229 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a91b816e-71dd-4135-8b18-f487d185549a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:40.172864 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-a91b816e-71dd-4135-8b18-f487d185549a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Getting quotas for project 3e4289e377d24036b968d0ae71c61dcc. Resources: {'instances', 'cores', 'ram'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:02:40.177567 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-a91b816e-71dd-4135-8b18-f487d185549a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Getting quotas for user 518ad5eb820e44aa9689215e6038a521 and project 3e4289e377d24036b968d0ae71c61dcc. Resources: {'instances', 'cores', 'ram'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:02:40.188246 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a91b816e-71dd-4135-8b18-f487d185549a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Going to run 1 instances... {{(pid=118187) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:02:40.190814 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a91b816e-71dd-4135-8b18-f487d185549a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 13239a17-d303-4280-ad70-46aa4dd02950] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0eec51c-83e9-420b-bcb9-20fe8dcf5321',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:02:40.234850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a91b816e-71dd-4135-8b18-f487d185549a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.496260 Jul 28 04:02:40.235494 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 251/450] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 04:02:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 8498 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:02:40.250023 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-bcfc10c4-8049-41b8-856a-2badb828cf81 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:40.250722 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-bcfc10c4-8049-41b8-856a-2badb828cf81 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 13239a17-d303-4280-ad70-46aa4dd02950] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:40.307949 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-bcfc10c4-8049-41b8-856a-2badb828cf81 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:40.314850 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-bcfc10c4-8049-41b8-856a-2badb828cf81 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950" status: 200 len: 1218 microversion: 2.1 time: 0.069414 Jul 28 04:02:40.315429 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 200/451] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:40 2022] GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950 => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:40.639088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-847dd47a-0c5d-4be6-9970-e4ca96b57c9c tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:40.639946 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-847dd47a-0c5d-4be6-9970-e4ca96b57c9c tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:40.652604 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-847dd47a-0c5d-4be6-9970-e4ca96b57c9c tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:40.653345 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-847dd47a-0c5d-4be6-9970-e4ca96b57c9c tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:40.654214 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-847dd47a-0c5d-4be6-9970-e4ca96b57c9c tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:40.654777 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-847dd47a-0c5d-4be6-9970-e4ca96b57c9c tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:40.789838 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-847dd47a-0c5d-4be6-9970-e4ca96b57c9c tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:40.797318 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-847dd47a-0c5d-4be6-9970-e4ca96b57c9c tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 200 len: 1367 microversion: 2.1 time: 0.163169 Jul 28 04:02:40.798212 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 252/452] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:40 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:41.006369 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-601039b5-78fa-49bf-af35-eebcce913667 req-37ccc7ce-88b7-46ca-b46d-f9fa084ecba3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa036966-7c31-4a36-97fd-4d3eadd09fb0", "name": "network-vif-plugged", "status": "completed", "tag": "df6e2763-2336-4f96-9cf5-6bda9111085f"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:41.019466 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-601039b5-78fa-49bf-af35-eebcce913667 req-37ccc7ce-88b7-46ca-b46d-f9fa084ecba3 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:41.019953 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-601039b5-78fa-49bf-af35-eebcce913667 req-37ccc7ce-88b7-46ca-b46d-f9fa084ecba3 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:41.031207 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-601039b5-78fa-49bf-af35-eebcce913667 req-37ccc7ce-88b7-46ca-b46d-f9fa084ecba3 service nova] Creating event network-vif-plugged:df6e2763-2336-4f96-9cf5-6bda9111085f for instance fa036966-7c31-4a36-97fd-4d3eadd09fb0 on hv-cinder-79987 Jul 28 04:02:41.036858 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-601039b5-78fa-49bf-af35-eebcce913667 req-37ccc7ce-88b7-46ca-b46d-f9fa084ecba3 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034202 Jul 28 04:02:41.037761 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 201/453] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:02:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:02:41.076987 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6ce6dca8-89ea-43e0-994e-14a90357ee95 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:41.077616 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6ce6dca8-89ea-43e0-994e-14a90357ee95 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:41.084433 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6ce6dca8-89ea-43e0-994e-14a90357ee95 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:41.084889 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6ce6dca8-89ea-43e0-994e-14a90357ee95 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:41.085668 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6ce6dca8-89ea-43e0-994e-14a90357ee95 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:41.086162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6ce6dca8-89ea-43e0-994e-14a90357ee95 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:41.234609 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6ce6dca8-89ea-43e0-994e-14a90357ee95 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:41.243002 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6ce6dca8-89ea-43e0-994e-14a90357ee95 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1371 microversion: 2.1 time: 0.170216 Jul 28 04:02:41.243556 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 253/454] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:41 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:41.337880 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-27afb38c-f870-4b79-ab08-5aea36c3be46 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:41.338580 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-27afb38c-f870-4b79-ab08-5aea36c3be46 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 13239a17-d303-4280-ad70-46aa4dd02950] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:41.344846 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-27afb38c-f870-4b79-ab08-5aea36c3be46 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:41.345921 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-27afb38c-f870-4b79-ab08-5aea36c3be46 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:41.347048 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-27afb38c-f870-4b79-ab08-5aea36c3be46 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:41.347486 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-27afb38c-f870-4b79-ab08-5aea36c3be46 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:41.418068 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-27afb38c-f870-4b79-ab08-5aea36c3be46 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:41.425709 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-27afb38c-f870-4b79-ab08-5aea36c3be46 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950" status: 200 len: 1270 microversion: 2.1 time: 0.092385 Jul 28 04:02:41.426292 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 202/455] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:41 2022] GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950 => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:41.819033 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-dad87e7f-a5ce-4c3c-86bc-912ffea2ffdb tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:41.819648 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-dad87e7f-a5ce-4c3c-86bc-912ffea2ffdb tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:41.825655 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dad87e7f-a5ce-4c3c-86bc-912ffea2ffdb tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:41.826104 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dad87e7f-a5ce-4c3c-86bc-912ffea2ffdb tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:41.826888 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dad87e7f-a5ce-4c3c-86bc-912ffea2ffdb tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:41.827323 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dad87e7f-a5ce-4c3c-86bc-912ffea2ffdb tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:41.966826 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-dad87e7f-a5ce-4c3c-86bc-912ffea2ffdb tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:41.974958 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-dad87e7f-a5ce-4c3c-86bc-912ffea2ffdb tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 200 len: 1367 microversion: 2.1 time: 0.160469 Jul 28 04:02:41.975741 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 254/456] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:41 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:42.264034 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-eb207c39-821e-48f2-9a6e-33ab614f5280 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:42.264746 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-eb207c39-821e-48f2-9a6e-33ab614f5280 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:42.271886 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-eb207c39-821e-48f2-9a6e-33ab614f5280 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:42.272334 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-eb207c39-821e-48f2-9a6e-33ab614f5280 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:42.273094 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-eb207c39-821e-48f2-9a6e-33ab614f5280 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:42.273552 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-eb207c39-821e-48f2-9a6e-33ab614f5280 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:42.446948 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-40999dd1-9b7d-46e5-b882-269a49f70c3f tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:42.447851 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-40999dd1-9b7d-46e5-b882-269a49f70c3f tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 13239a17-d303-4280-ad70-46aa4dd02950] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:42.455470 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-40999dd1-9b7d-46e5-b882-269a49f70c3f tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:42.456500 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-40999dd1-9b7d-46e5-b882-269a49f70c3f tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:42.458239 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-40999dd1-9b7d-46e5-b882-269a49f70c3f tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:42.458683 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-40999dd1-9b7d-46e5-b882-269a49f70c3f tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:42.477245 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:42.483792 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-eb207c39-821e-48f2-9a6e-33ab614f5280 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:42.491563 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-eb207c39-821e-48f2-9a6e-33ab614f5280 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1371 microversion: 2.1 time: 0.231458 Jul 28 04:02:42.492888 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 203/457] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:42 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1371 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:42.612437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-40999dd1-9b7d-46e5-b882-269a49f70c3f tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:42.621470 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-40999dd1-9b7d-46e5-b882-269a49f70c3f tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950" status: 200 len: 1318 microversion: 2.1 time: 0.178442 Jul 28 04:02:42.621629 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 255/458] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:42 2022] GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:42.996618 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-13ffffb5-24c8-442d-9ad0-86e782cf5c83 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:42.997255 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-13ffffb5-24c8-442d-9ad0-86e782cf5c83 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:43.004120 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-13ffffb5-24c8-442d-9ad0-86e782cf5c83 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:43.004722 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-13ffffb5-24c8-442d-9ad0-86e782cf5c83 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:43.005984 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-13ffffb5-24c8-442d-9ad0-86e782cf5c83 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:43.012479 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-13ffffb5-24c8-442d-9ad0-86e782cf5c83 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:43.353707 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-13ffffb5-24c8-442d-9ad0-86e782cf5c83 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:43.362273 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-13ffffb5-24c8-442d-9ad0-86e782cf5c83 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 200 len: 1367 microversion: 2.1 time: 0.369814 Jul 28 04:02:43.362865 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 204/459] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:42 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 1367 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:43.513947 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8be7d4f7-91a6-4521-9375-d41210b0c768 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:43.514644 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8be7d4f7-91a6-4521-9375-d41210b0c768 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:43.522183 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8be7d4f7-91a6-4521-9375-d41210b0c768 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:43.523094 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8be7d4f7-91a6-4521-9375-d41210b0c768 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:43.524080 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8be7d4f7-91a6-4521-9375-d41210b0c768 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:43.524729 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8be7d4f7-91a6-4521-9375-d41210b0c768 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:43.643622 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-015b1b3a-e429-4baa-84ff-9554de37318c tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:43.644250 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-015b1b3a-e429-4baa-84ff-9554de37318c tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 13239a17-d303-4280-ad70-46aa4dd02950] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:43.656311 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-015b1b3a-e429-4baa-84ff-9554de37318c tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:43.656774 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-015b1b3a-e429-4baa-84ff-9554de37318c tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:43.657534 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-015b1b3a-e429-4baa-84ff-9554de37318c tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:43.658544 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-015b1b3a-e429-4baa-84ff-9554de37318c tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:43.703523 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8be7d4f7-91a6-4521-9375-d41210b0c768 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:43.711982 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8be7d4f7-91a6-4521-9375-d41210b0c768 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1371 microversion: 2.1 time: 0.202059 Jul 28 04:02:43.712612 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 256/460] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:43 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:43.856105 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-8dc559db-1b93-4591-8ac3-0d6fead0a697 req-4fdaecf9-d857-4bb8-8951-239fc60cc659 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "13239a17-d303-4280-ad70-46aa4dd02950", "tag": "4c3ddfdf-2483-4843-80f6-0a92acc6a405"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:43.866929 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-8dc559db-1b93-4591-8ac3-0d6fead0a697 req-4fdaecf9-d857-4bb8-8951-239fc60cc659 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:43.867380 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-8dc559db-1b93-4591-8ac3-0d6fead0a697 req-4fdaecf9-d857-4bb8-8951-239fc60cc659 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:43.878618 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-8dc559db-1b93-4591-8ac3-0d6fead0a697 req-4fdaecf9-d857-4bb8-8951-239fc60cc659 service nova] Creating event network-changed:4c3ddfdf-2483-4843-80f6-0a92acc6a405 for instance 13239a17-d303-4280-ad70-46aa4dd02950 on hv-cinder-79987 Jul 28 04:02:43.883544 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-8dc559db-1b93-4591-8ac3-0d6fead0a697 req-4fdaecf9-d857-4bb8-8951-239fc60cc659 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031090 Jul 28 04:02:43.884139 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 257/461] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:02:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:02:43.885249 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-015b1b3a-e429-4baa-84ff-9554de37318c tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:43.893268 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-015b1b3a-e429-4baa-84ff-9554de37318c tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950" status: 200 len: 1318 microversion: 2.1 time: 0.254041 Jul 28 04:02:43.893833 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 205/462] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:43 2022] GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950 => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:44.389799 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-eb10226a-fc92-4562-827c-ff52f1bbfd0e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:44.390824 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-eb10226a-fc92-4562-827c-ff52f1bbfd0e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:44.399056 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-eb10226a-fc92-4562-827c-ff52f1bbfd0e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:44.399617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-eb10226a-fc92-4562-827c-ff52f1bbfd0e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:44.400548 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-eb10226a-fc92-4562-827c-ff52f1bbfd0e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:44.401162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-eb10226a-fc92-4562-827c-ff52f1bbfd0e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:44.556403 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-eb10226a-fc92-4562-827c-ff52f1bbfd0e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:44.564685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-eb10226a-fc92-4562-827c-ff52f1bbfd0e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 200 len: 1557 microversion: 2.1 time: 0.179537 Jul 28 04:02:44.565393 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 258/463] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:44 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 1557 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:44.585512 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-66c0e1f8-2adc-4fa0-9857-98b2c5f03e7d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:44.586052 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-66c0e1f8-2adc-4fa0-9857-98b2c5f03e7d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:44.592295 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-66c0e1f8-2adc-4fa0-9857-98b2c5f03e7d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:44.592748 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-66c0e1f8-2adc-4fa0-9857-98b2c5f03e7d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:44.593546 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-66c0e1f8-2adc-4fa0-9857-98b2c5f03e7d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:44.593983 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-66c0e1f8-2adc-4fa0-9857-98b2c5f03e7d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:44.732600 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-66c0e1f8-2adc-4fa0-9857-98b2c5f03e7d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.151198 Jul 28 04:02:44.733188 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 206/464] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Jul 28 04:02:44 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0/os-interface => generated 285 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:02:44.741798 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-773c5fae-2af4-4e32-bc52-0577a8605eb9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:44.742630 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-773c5fae-2af4-4e32-bc52-0577a8605eb9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:44.749079 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-773c5fae-2af4-4e32-bc52-0577a8605eb9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:44.749761 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-773c5fae-2af4-4e32-bc52-0577a8605eb9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:44.750551 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-773c5fae-2af4-4e32-bc52-0577a8605eb9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:44.751487 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-773c5fae-2af4-4e32-bc52-0577a8605eb9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:44.915050 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-eac83238-b9de-4de0-aa2a-f0ad3b74a030 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:44.916302 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-eac83238-b9de-4de0-aa2a-f0ad3b74a030 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 13239a17-d303-4280-ad70-46aa4dd02950] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:44.927581 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-eac83238-b9de-4de0-aa2a-f0ad3b74a030 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:44.928498 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-eac83238-b9de-4de0-aa2a-f0ad3b74a030 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:44.929618 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-eac83238-b9de-4de0-aa2a-f0ad3b74a030 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:44.930059 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-eac83238-b9de-4de0-aa2a-f0ad3b74a030 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:45.041728 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-773c5fae-2af4-4e32-bc52-0577a8605eb9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:45.055325 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-773c5fae-2af4-4e32-bc52-0577a8605eb9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1371 microversion: 2.1 time: 0.325626 Jul 28 04:02:45.071797 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 259/465] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:44 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1371 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:45.080330 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-eb2cf0c9-3234-45e0-b06f-59face4fae5a req-ed3080e9-f4cf-4def-9d48-f872fef6ff62 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe24f923-0389-4154-a7bb-062800043d11", "name": "network-vif-plugged", "status": "completed", "tag": "606d30e1-9cda-4404-8c90-b1f1e3b45f28"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:45.088942 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-eac83238-b9de-4de0-aa2a-f0ad3b74a030 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:45.093841 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-eb2cf0c9-3234-45e0-b06f-59face4fae5a req-ed3080e9-f4cf-4def-9d48-f872fef6ff62 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:45.094644 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-eb2cf0c9-3234-45e0-b06f-59face4fae5a req-ed3080e9-f4cf-4def-9d48-f872fef6ff62 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:45.099370 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-eac83238-b9de-4de0-aa2a-f0ad3b74a030 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950" status: 200 len: 1318 microversion: 2.1 time: 0.188989 Jul 28 04:02:45.100833 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 207/466] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:44 2022] GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:45.116044 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-eb2cf0c9-3234-45e0-b06f-59face4fae5a req-ed3080e9-f4cf-4def-9d48-f872fef6ff62 service nova] Creating event network-vif-plugged:606d30e1-9cda-4404-8c90-b1f1e3b45f28 for instance fe24f923-0389-4154-a7bb-062800043d11 on hv-cinder-79987 Jul 28 04:02:45.125405 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-eb2cf0c9-3234-45e0-b06f-59face4fae5a req-ed3080e9-f4cf-4def-9d48-f872fef6ff62 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052007 Jul 28 04:02:45.126191 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 260/467] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:02:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:02:46.021156 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-3c4aa204-ac8b-46ec-b7ac-144f168719f7 req-627fc819-01ca-4d61-ac6c-909f03ce399c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa036966-7c31-4a36-97fd-4d3eadd09fb0", "tag": "df6e2763-2336-4f96-9cf5-6bda9111085f"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:46.026584 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:46.032584 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-3c4aa204-ac8b-46ec-b7ac-144f168719f7 req-627fc819-01ca-4d61-ac6c-909f03ce399c service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:46.033879 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-3c4aa204-ac8b-46ec-b7ac-144f168719f7 req-627fc819-01ca-4d61-ac6c-909f03ce399c service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:46.046473 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-3c4aa204-ac8b-46ec-b7ac-144f168719f7 req-627fc819-01ca-4d61-ac6c-909f03ce399c service nova] Creating event network-changed:df6e2763-2336-4f96-9cf5-6bda9111085f for instance fa036966-7c31-4a36-97fd-4d3eadd09fb0 on hv-cinder-79987 Jul 28 04:02:46.051851 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-3c4aa204-ac8b-46ec-b7ac-144f168719f7 req-627fc819-01ca-4d61-ac6c-909f03ce399c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035367 Jul 28 04:02:46.052450 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 208/468] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:02:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:02:46.079068 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ecf6404a-27fd-49ff-b6d5-e5185dda9f83 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:46.080555 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ecf6404a-27fd-49ff-b6d5-e5185dda9f83 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:46.087130 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ecf6404a-27fd-49ff-b6d5-e5185dda9f83 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:46.087590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ecf6404a-27fd-49ff-b6d5-e5185dda9f83 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:46.088364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ecf6404a-27fd-49ff-b6d5-e5185dda9f83 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:46.088797 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ecf6404a-27fd-49ff-b6d5-e5185dda9f83 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:46.123286 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c0b54232-b6db-4ced-9ac1-6352f27cb87d tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:46.123941 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c0b54232-b6db-4ced-9ac1-6352f27cb87d tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 13239a17-d303-4280-ad70-46aa4dd02950] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:46.132340 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c0b54232-b6db-4ced-9ac1-6352f27cb87d tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:46.132340 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c0b54232-b6db-4ced-9ac1-6352f27cb87d tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:46.132653 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c0b54232-b6db-4ced-9ac1-6352f27cb87d tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:46.133086 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c0b54232-b6db-4ced-9ac1-6352f27cb87d tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:46.241880 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ecf6404a-27fd-49ff-b6d5-e5185dda9f83 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:46.249701 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ecf6404a-27fd-49ff-b6d5-e5185dda9f83 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1371 microversion: 2.1 time: 0.175043 Jul 28 04:02:46.250498 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 261/469] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:46 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:46.290704 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-c0b54232-b6db-4ced-9ac1-6352f27cb87d tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:46.298215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-c0b54232-b6db-4ced-9ac1-6352f27cb87d tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950" status: 200 len: 1318 microversion: 2.1 time: 0.180444 Jul 28 04:02:46.298987 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 209/470] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:46 2022] GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950 => generated 1318 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:47.273739 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-35fc861f-124b-4afa-b66b-96f3820fa571 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:47.274871 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-35fc861f-124b-4afa-b66b-96f3820fa571 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:47.289288 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-35fc861f-124b-4afa-b66b-96f3820fa571 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:47.290724 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-35fc861f-124b-4afa-b66b-96f3820fa571 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:47.297200 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-35fc861f-124b-4afa-b66b-96f3820fa571 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:47.297886 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-35fc861f-124b-4afa-b66b-96f3820fa571 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:47.320013 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-6e237839-46c1-40d1-9b19-3cf743861c0a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:47.320646 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-6e237839-46c1-40d1-9b19-3cf743861c0a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 13239a17-d303-4280-ad70-46aa4dd02950] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:47.335416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6e237839-46c1-40d1-9b19-3cf743861c0a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:47.335887 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6e237839-46c1-40d1-9b19-3cf743861c0a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:47.336689 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6e237839-46c1-40d1-9b19-3cf743861c0a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:47.337127 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6e237839-46c1-40d1-9b19-3cf743861c0a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:47.525490 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-35fc861f-124b-4afa-b66b-96f3820fa571 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:47.534734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-35fc861f-124b-4afa-b66b-96f3820fa571 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1371 microversion: 2.1 time: 0.265863 Jul 28 04:02:47.548512 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 262/471] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:47 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1371 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:47.561617 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-6e237839-46c1-40d1-9b19-3cf743861c0a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:47.572590 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-6e237839-46c1-40d1-9b19-3cf743861c0a tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950" status: 200 len: 1318 microversion: 2.1 time: 0.256683 Jul 28 04:02:47.573181 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 210/472] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:47 2022] GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:48.555714 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3bef059e-bb38-49b5-9af4-cf89f5b870f6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:48.556342 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3bef059e-bb38-49b5-9af4-cf89f5b870f6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:48.562331 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3bef059e-bb38-49b5-9af4-cf89f5b870f6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:48.562800 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3bef059e-bb38-49b5-9af4-cf89f5b870f6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:48.563582 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3bef059e-bb38-49b5-9af4-cf89f5b870f6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:48.564574 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3bef059e-bb38-49b5-9af4-cf89f5b870f6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:48.595646 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-6aff8dea-cc02-4771-bd57-8fdb2fe8a4ee tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:48.596341 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-6aff8dea-cc02-4771-bd57-8fdb2fe8a4ee tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 13239a17-d303-4280-ad70-46aa4dd02950] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:48.602659 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6aff8dea-cc02-4771-bd57-8fdb2fe8a4ee tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:48.603126 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6aff8dea-cc02-4771-bd57-8fdb2fe8a4ee tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:48.603895 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6aff8dea-cc02-4771-bd57-8fdb2fe8a4ee tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:48.604324 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6aff8dea-cc02-4771-bd57-8fdb2fe8a4ee tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:48.698804 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3bef059e-bb38-49b5-9af4-cf89f5b870f6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:48.707112 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3bef059e-bb38-49b5-9af4-cf89f5b870f6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1566 microversion: 2.1 time: 0.155201 Jul 28 04:02:48.707692 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 263/473] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:48 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:48.728245 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-eb3a330a-421a-4048-980a-d30c322d57f6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:48.729021 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-eb3a330a-421a-4048-980a-d30c322d57f6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:48.735290 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-eb3a330a-421a-4048-980a-d30c322d57f6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:48.735923 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-eb3a330a-421a-4048-980a-d30c322d57f6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:48.736760 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-eb3a330a-421a-4048-980a-d30c322d57f6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:48.737203 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-eb3a330a-421a-4048-980a-d30c322d57f6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:48.741965 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-6aff8dea-cc02-4771-bd57-8fdb2fe8a4ee tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:48.749399 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-6aff8dea-cc02-4771-bd57-8fdb2fe8a4ee tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950" status: 200 len: 1318 microversion: 2.1 time: 0.159245 Jul 28 04:02:48.749975 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 211/474] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:48 2022] GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950 => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:48.813259 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-eb3a330a-421a-4048-980a-d30c322d57f6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088827 Jul 28 04:02:48.814102 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 264/475] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Jul 28 04:02:48 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:02:49.042602 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-2306489a-010e-4946-b35f-b52f9ec1322c req-36003e57-6a93-4b1c-8b79-f0a27b51e498 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13239a17-d303-4280-ad70-46aa4dd02950", "name": "network-vif-plugged", "status": "completed", "tag": "4c3ddfdf-2483-4843-80f6-0a92acc6a405"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:49.053958 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-2306489a-010e-4946-b35f-b52f9ec1322c req-36003e57-6a93-4b1c-8b79-f0a27b51e498 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:49.054412 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-2306489a-010e-4946-b35f-b52f9ec1322c req-36003e57-6a93-4b1c-8b79-f0a27b51e498 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:49.066698 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-2306489a-010e-4946-b35f-b52f9ec1322c req-36003e57-6a93-4b1c-8b79-f0a27b51e498 service nova] Creating event network-vif-plugged:4c3ddfdf-2483-4843-80f6-0a92acc6a405 for instance 13239a17-d303-4280-ad70-46aa4dd02950 on hv-cinder-79987 Jul 28 04:02:49.071948 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-2306489a-010e-4946-b35f-b52f9ec1322c req-36003e57-6a93-4b1c-8b79-f0a27b51e498 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033217 Jul 28 04:02:49.073258 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 212/476] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:02:49.770588 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-32822c9a-e073-4c36-af0d-08eb64d6cc27 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:49.771020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-32822c9a-e073-4c36-af0d-08eb64d6cc27 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 13239a17-d303-4280-ad70-46aa4dd02950] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:49.777799 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-32822c9a-e073-4c36-af0d-08eb64d6cc27 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:49.778424 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-32822c9a-e073-4c36-af0d-08eb64d6cc27 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:49.779394 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-32822c9a-e073-4c36-af0d-08eb64d6cc27 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:49.779837 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-32822c9a-e073-4c36-af0d-08eb64d6cc27 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:49.811627 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-d4c0194c-bf73-4486-be93-e4fb4b74a766 req-c092d681-1a11-4f83-8a9e-0465a2263185 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe24f923-0389-4154-a7bb-062800043d11", "tag": "606d30e1-9cda-4404-8c90-b1f1e3b45f28"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:49.823542 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-d4c0194c-bf73-4486-be93-e4fb4b74a766 req-c092d681-1a11-4f83-8a9e-0465a2263185 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:49.823982 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-d4c0194c-bf73-4486-be93-e4fb4b74a766 req-c092d681-1a11-4f83-8a9e-0465a2263185 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:49.828118 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=100 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:49.836811 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-d4c0194c-bf73-4486-be93-e4fb4b74a766 req-c092d681-1a11-4f83-8a9e-0465a2263185 service nova] Creating event network-changed:606d30e1-9cda-4404-8c90-b1f1e3b45f28 for instance fe24f923-0389-4154-a7bb-062800043d11 on hv-cinder-79987 Jul 28 04:02:49.841583 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-d4c0194c-bf73-4486-be93-e4fb4b74a766 req-c092d681-1a11-4f83-8a9e-0465a2263185 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034362 Jul 28 04:02:49.842179 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 213/477] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:02:49.928353 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-32822c9a-e073-4c36-af0d-08eb64d6cc27 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:49.939638 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-32822c9a-e073-4c36-af0d-08eb64d6cc27 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950" status: 200 len: 1318 microversion: 2.1 time: 0.173339 Jul 28 04:02:49.940396 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 265/478] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:49 2022] GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950 => generated 1318 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:02:50.957684 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell0:SELECT=2 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:50.962332 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-d2d0254b-c2df-4359-b6b2-e4bf1d282113 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:02:50.967066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-d2d0254b-c2df-4359-b6b2-e4bf1d282113 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 13239a17-d303-4280-ad70-46aa4dd02950] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:50.973876 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d2d0254b-c2df-4359-b6b2-e4bf1d282113 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:50.974327 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d2d0254b-c2df-4359-b6b2-e4bf1d282113 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:50.975242 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d2d0254b-c2df-4359-b6b2-e4bf1d282113 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:50.975837 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d2d0254b-c2df-4359-b6b2-e4bf1d282113 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:51.117195 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-d2d0254b-c2df-4359-b6b2-e4bf1d282113 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:02:51.124995 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-d2d0254b-c2df-4359-b6b2-e4bf1d282113 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950" status: 200 len: 1506 microversion: 2.1 time: 0.168269 Jul 28 04:02:51.125584 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 214/479] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:02:50 2022] GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950 => generated 1506 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:02:51.146174 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-67368e80-bc50-429f-976e-245bc50a03c9 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "365c4229-4e24-4763-8cae-1362d977d8ca", "device": "/dev/sdb"}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:02:51.149214 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-67368e80-bc50-429f-976e-245bc50a03c9 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 13239a17-d303-4280-ad70-46aa4dd02950] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:02:51.151144 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:51.151798 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=6 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:02:51.159700 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-67368e80-bc50-429f-976e-245bc50a03c9 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:51.160383 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-67368e80-bc50-429f-976e-245bc50a03c9 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:51.161173 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-67368e80-bc50-429f-976e-245bc50a03c9 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:02:51.161606 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-67368e80-bc50-429f-976e-245bc50a03c9 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:02:51.801834 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-67368e80-bc50-429f-976e-245bc50a03c9 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "POST /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.660108 Jul 28 04:02:51.802642 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 266/480] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Jul 28 04:02:51 2022] POST /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950/os-volume_attachments => generated 194 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:04.523974 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=13 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:04.524857 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=6 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:04.691893 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-5c4b6b3e-69ee-4e6c-b453-c72f051cf1b7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Action: 'create', calling method: .version_select at 0x7fa6eebc9af0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1551827242", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ/Vm7nlBT/xh5pj+J2PCDw3GrD475IaHK0IvNCLxNIVZmS6JAeEdtfDQPJjxovptrgddIs+uhaAY6KVQeJ5BLEGl+5WL2G5g/7oDKyp2v/EKBmgxwGPc5FFn21n8CnUcA=="}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:04.716885 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-5c4b6b3e-69ee-4e6c-b453-c72f051cf1b7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Getting quotas for project 338679f381ed4e9e898a59289b0f8178. Resources: {'key_pairs'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:03:04.723307 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-5c4b6b3e-69ee-4e6c-b453-c72f051cf1b7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Getting quotas for user 352d60372ba249e38ea4aa2d62723f19 and project 338679f381ed4e9e898a59289b0f8178. Resources: {'key_pairs'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:03:04.766968 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-5c4b6b3e-69ee-4e6c-b453-c72f051cf1b7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.247482 Jul 28 04:03:04.770353 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 215/481] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 04:03:04 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:16.307865 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:16.308778 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=63,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:16.313749 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3bc62fb5-413e-4097-9192-6e69ed652298 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:16.314320 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3bc62fb5-413e-4097-9192-6e69ed652298 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:16.322670 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3bc62fb5-413e-4097-9192-6e69ed652298 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:16.323332 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3bc62fb5-413e-4097-9192-6e69ed652298 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:16.324103 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3bc62fb5-413e-4097-9192-6e69ed652298 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:16.324537 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3bc62fb5-413e-4097-9192-6e69ed652298 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:16.408545 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.objects.instance [None req-3bc62fb5-413e-4097-9192-6e69ed652298 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lazy-loading 'services' on Instance uuid beb705c5-be1c-471d-82d9-b6d699ead475 {{(pid=118187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:03:16.483170 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3bc62fb5-413e-4097-9192-6e69ed652298 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "DELETE /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475/os-volume_attachments/d2b9140e-40c1-42fa-a950-1003ef497f9e" status: 202 len: 0 microversion: 2.1 time: 0.176655 Jul 28 04:03:16.484042 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 267/482] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Jul 28 04:03:16 2022] DELETE /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475/os-volume_attachments/d2b9140e-40c1-42fa-a950-1003ef497f9e => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:03:21.839709 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell0:SELECT=4 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:21.840485 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:21.845205 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-62c6489d-a444-4197-9c95-7e7906b63435 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:21.854628 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-62c6489d-a444-4197-9c95-7e7906b63435 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:21.855176 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-62c6489d-a444-4197-9c95-7e7906b63435 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:21.880134 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-62c6489d-a444-4197-9c95-7e7906b63435 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Going to try to stop instance {{(pid=118186) force_stop /opt/stack/nova/nova/compute/api.py:2710}} Jul 28 04:03:21.926895 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-62c6489d-a444-4197-9c95-7e7906b63435 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "POST /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475/action" status: 202 len: 0 microversion: 2.1 time: 0.088482 Jul 28 04:03:21.927669 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 216/483] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Jul 28 04:03:21 2022] POST /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:03:21.936155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5efa32f5-53e1-4ccd-9509-f1259b9968dd tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:21.937479 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5efa32f5-53e1-4ccd-9509-f1259b9968dd tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:21.945170 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5efa32f5-53e1-4ccd-9509-f1259b9968dd tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:21.946045 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5efa32f5-53e1-4ccd-9509-f1259b9968dd tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:21.947117 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5efa32f5-53e1-4ccd-9509-f1259b9968dd tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:21.947631 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5efa32f5-53e1-4ccd-9509-f1259b9968dd tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:22.082332 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5efa32f5-53e1-4ccd-9509-f1259b9968dd tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:22.089437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5efa32f5-53e1-4ccd-9509-f1259b9968dd tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1676 microversion: 2.1 time: 0.157562 Jul 28 04:03:22.090006 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 268/484] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:21 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1676 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:22.981447 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-f3b6c142-1958-4fbb-bdab-7f1ec6e2b2bf tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:22.982037 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-f3b6c142-1958-4fbb-bdab-7f1ec6e2b2bf tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 13239a17-d303-4280-ad70-46aa4dd02950] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:22.988318 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f3b6c142-1958-4fbb-bdab-7f1ec6e2b2bf tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:22.988772 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f3b6c142-1958-4fbb-bdab-7f1ec6e2b2bf tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:22.989538 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f3b6c142-1958-4fbb-bdab-7f1ec6e2b2bf tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:22.989976 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f3b6c142-1958-4fbb-bdab-7f1ec6e2b2bf tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:23.111666 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9b5a4886-3a07-4847-9251-88c17c6a5335 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:23.112292 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9b5a4886-3a07-4847-9251-88c17c6a5335 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:23.120725 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9b5a4886-3a07-4847-9251-88c17c6a5335 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:23.121185 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9b5a4886-3a07-4847-9251-88c17c6a5335 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:23.122256 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9b5a4886-3a07-4847-9251-88c17c6a5335 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:23.123741 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9b5a4886-3a07-4847-9251-88c17c6a5335 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:23.129692 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.objects.instance [None req-f3b6c142-1958-4fbb-bdab-7f1ec6e2b2bf tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lazy-loading 'services' on Instance uuid 13239a17-d303-4280-ad70-46aa4dd02950 {{(pid=118186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:03:23.266313 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-f3b6c142-1958-4fbb-bdab-7f1ec6e2b2bf tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "DELETE /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950/os-volume_attachments/365c4229-4e24-4763-8cae-1362d977d8ca" status: 202 len: 0 microversion: 2.1 time: 0.288902 Jul 28 04:03:23.267455 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 217/485] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Jul 28 04:03:22 2022] DELETE /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950/os-volume_attachments/365c4229-4e24-4763-8cae-1362d977d8ca => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:03:23.280485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9b5a4886-3a07-4847-9251-88c17c6a5335 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:23.290490 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9b5a4886-3a07-4847-9251-88c17c6a5335 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1676 microversion: 2.1 time: 0.183279 Jul 28 04:03:23.291533 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 269/486] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:23 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:24.313940 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-74ba142d-31ed-4950-a740-0f323b17d062 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:24.314662 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-74ba142d-31ed-4950-a740-0f323b17d062 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:24.321984 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-74ba142d-31ed-4950-a740-0f323b17d062 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:24.322429 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-74ba142d-31ed-4950-a740-0f323b17d062 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:24.323222 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-74ba142d-31ed-4950-a740-0f323b17d062 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:24.323651 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-74ba142d-31ed-4950-a740-0f323b17d062 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:24.419541 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-80b6f380-1730-47d0-954e-3504f02b7115 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:24.420028 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-80b6f380-1730-47d0-954e-3504f02b7115 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 13239a17-d303-4280-ad70-46aa4dd02950] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:24.426856 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-80b6f380-1730-47d0-954e-3504f02b7115 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:24.427306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-80b6f380-1730-47d0-954e-3504f02b7115 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:24.428099 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-80b6f380-1730-47d0-954e-3504f02b7115 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:24.428593 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-80b6f380-1730-47d0-954e-3504f02b7115 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:24.455028 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-80b6f380-1730-47d0-954e-3504f02b7115 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 13239a17-d303-4280-ad70-46aa4dd02950] Going to try to terminate instance {{(pid=118187) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:03:24.461615 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-74ba142d-31ed-4950-a740-0f323b17d062 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:24.469443 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-74ba142d-31ed-4950-a740-0f323b17d062 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1676 microversion: 2.1 time: 0.160132 Jul 28 04:03:24.470035 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 218/487] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:24 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:24.537999 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-80b6f380-1730-47d0-954e-3504f02b7115 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "DELETE /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950" status: 204 len: 0 microversion: 2.1 time: 0.115580 Jul 28 04:03:24.537999 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 270/488] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:03:24 2022] DELETE /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:03:24.541728 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-6b7b2cc4-3a2a-4938-bc8b-05d26322487b tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:24.542340 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-6b7b2cc4-3a2a-4938-bc8b-05d26322487b tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 13239a17-d303-4280-ad70-46aa4dd02950] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:24.548407 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6b7b2cc4-3a2a-4938-bc8b-05d26322487b tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:24.548850 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6b7b2cc4-3a2a-4938-bc8b-05d26322487b tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:24.549635 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6b7b2cc4-3a2a-4938-bc8b-05d26322487b tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:24.550068 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6b7b2cc4-3a2a-4938-bc8b-05d26322487b tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:24.680580 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-6b7b2cc4-3a2a-4938-bc8b-05d26322487b tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:24.689070 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-6b7b2cc4-3a2a-4938-bc8b-05d26322487b tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950" status: 200 len: 1512 microversion: 2.1 time: 0.151558 Jul 28 04:03:24.689645 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 219/489] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:24 2022] GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950 => generated 1512 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:25.491382 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ec927c1f-dc7a-4d13-8f85-aef9302aeb19 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:25.492078 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ec927c1f-dc7a-4d13-8f85-aef9302aeb19 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:25.498496 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ec927c1f-dc7a-4d13-8f85-aef9302aeb19 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:25.498975 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ec927c1f-dc7a-4d13-8f85-aef9302aeb19 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:25.499730 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ec927c1f-dc7a-4d13-8f85-aef9302aeb19 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:25.500163 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ec927c1f-dc7a-4d13-8f85-aef9302aeb19 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:25.634494 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ec927c1f-dc7a-4d13-8f85-aef9302aeb19 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:25.642083 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ec927c1f-dc7a-4d13-8f85-aef9302aeb19 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1676 microversion: 2.1 time: 0.154983 Jul 28 04:03:25.642753 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 271/490] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:25 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1676 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:25.709914 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c52dd93d-21b5-470d-8ee4-06b8539ec7c0 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:25.710630 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c52dd93d-21b5-470d-8ee4-06b8539ec7c0 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 13239a17-d303-4280-ad70-46aa4dd02950] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:25.717638 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c52dd93d-21b5-470d-8ee4-06b8539ec7c0 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:25.718083 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c52dd93d-21b5-470d-8ee4-06b8539ec7c0 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:25.718884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c52dd93d-21b5-470d-8ee4-06b8539ec7c0 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:25.719314 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c52dd93d-21b5-470d-8ee4-06b8539ec7c0 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:25.855136 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-c52dd93d-21b5-470d-8ee4-06b8539ec7c0 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:25.863462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-c52dd93d-21b5-470d-8ee4-06b8539ec7c0 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950" status: 200 len: 1512 microversion: 2.1 time: 0.157327 Jul 28 04:03:25.864301 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 220/491] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:25 2022] GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950 => generated 1512 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:26.664189 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9607cc8d-6725-4dd8-9743-49c487564386 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:26.664902 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9607cc8d-6725-4dd8-9743-49c487564386 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:26.671610 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9607cc8d-6725-4dd8-9743-49c487564386 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:26.672070 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9607cc8d-6725-4dd8-9743-49c487564386 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:26.672841 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9607cc8d-6725-4dd8-9743-49c487564386 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:26.673284 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9607cc8d-6725-4dd8-9743-49c487564386 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:26.808488 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9607cc8d-6725-4dd8-9743-49c487564386 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:26.816358 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9607cc8d-6725-4dd8-9743-49c487564386 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1676 microversion: 2.1 time: 0.156361 Jul 28 04:03:26.816930 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 272/492] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:26 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:26.885667 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-e497aa40-d17f-4542-8082-8cf37746da45 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:26.886810 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-e497aa40-d17f-4542-8082-8cf37746da45 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 13239a17-d303-4280-ad70-46aa4dd02950] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:26.893743 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e497aa40-d17f-4542-8082-8cf37746da45 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:26.894192 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e497aa40-d17f-4542-8082-8cf37746da45 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:26.894993 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e497aa40-d17f-4542-8082-8cf37746da45 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:26.895425 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e497aa40-d17f-4542-8082-8cf37746da45 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:27.138238 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-e497aa40-d17f-4542-8082-8cf37746da45 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '518ad5eb820e44aa9689215e6038a521', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4289e377d24036b968d0ae71c61dcc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:27.147246 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-e497aa40-d17f-4542-8082-8cf37746da45 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950" status: 200 len: 1512 microversion: 2.1 time: 0.265423 Jul 28 04:03:27.148223 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 221/493] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:26 2022] GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950 => generated 1512 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:27.150817 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-499919bd-8b55-449f-bf72-5387e1b50fad req-f276a0c4-7a99-4481-a32d-68377cd75b91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "13239a17-d303-4280-ad70-46aa4dd02950", "name": "network-vif-deleted", "tag": "4c3ddfdf-2483-4843-80f6-0a92acc6a405"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:27.162964 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-499919bd-8b55-449f-bf72-5387e1b50fad req-f276a0c4-7a99-4481-a32d-68377cd75b91 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:27.163419 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-499919bd-8b55-449f-bf72-5387e1b50fad req-f276a0c4-7a99-4481-a32d-68377cd75b91 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:27.175042 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-499919bd-8b55-449f-bf72-5387e1b50fad req-f276a0c4-7a99-4481-a32d-68377cd75b91 service nova] Creating event network-vif-deleted:4c3ddfdf-2483-4843-80f6-0a92acc6a405 for instance 13239a17-d303-4280-ad70-46aa4dd02950 on hv-cinder-79987 Jul 28 04:03:27.179831 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-499919bd-8b55-449f-bf72-5387e1b50fad req-f276a0c4-7a99-4481-a32d-68377cd75b91 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032732 Jul 28 04:03:27.180420 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 273/494] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:03:27.837463 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-190d4c20-cc7d-4f87-8ed9-3fe1a998d31c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:27.838003 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-190d4c20-cc7d-4f87-8ed9-3fe1a998d31c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:27.844018 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-190d4c20-cc7d-4f87-8ed9-3fe1a998d31c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:27.844470 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-190d4c20-cc7d-4f87-8ed9-3fe1a998d31c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:27.845235 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-190d4c20-cc7d-4f87-8ed9-3fe1a998d31c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:27.845709 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-190d4c20-cc7d-4f87-8ed9-3fe1a998d31c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:27.985719 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-190d4c20-cc7d-4f87-8ed9-3fe1a998d31c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:27.994511 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-190d4c20-cc7d-4f87-8ed9-3fe1a998d31c tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1676 microversion: 2.1 time: 0.160886 Jul 28 04:03:27.995175 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 222/495] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:27 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1676 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:28.169527 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8c150755-ccdf-494e-b684-f82fe0cf74d5 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:28.170428 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8c150755-ccdf-494e-b684-f82fe0cf74d5 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] [instance: 13239a17-d303-4280-ad70-46aa4dd02950] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:28.177264 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8c150755-ccdf-494e-b684-f82fe0cf74d5 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:28.177829 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8c150755-ccdf-494e-b684-f82fe0cf74d5 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:28.178640 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8c150755-ccdf-494e-b684-f82fe0cf74d5 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:28.179111 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8c150755-ccdf-494e-b684-f82fe0cf74d5 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:28.193478 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-8c150755-ccdf-494e-b684-f82fe0cf74d5 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] HTTP exception thrown: Instance 13239a17-d303-4280-ad70-46aa4dd02950 could not be found. Jul 28 04:03:28.195108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8c150755-ccdf-494e-b684-f82fe0cf74d5 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Request method failure captured: Jul 28 04:03:28.195108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950 HTTP/1.1 Jul 28 04:03:28.195108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:03:28.195108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:03:28.195108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:03:28.195108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:03:28.195108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:03:28.195108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:03:28.195108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:03:28.195108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:03:28.195108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gnlHQ53KXWbcHoQWI3iPZe4JPyp0avePqbrDsTc3tTM3JDrpDvRxZxxbxLKiOpy_g5HNV24G3vLySgW_7n5kmhrCq8_k0obWtLR33kxdDa9vIphA4JEejoW-1Y3NL6jVku_IdCPlE8nqhvyKCx-w4X3798LZWfGdnnsjptbcjKtvZY Jul 28 04:03:28.195108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:03:28.195108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:03:28.195108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:03:28.195108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:03:28.195108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:03:28.195108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:03:28.195108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 3e4289e377d24036b968d0ae71c61dcc Jul 28 04:03:28.195108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1815150758 Jul 28 04:03:28.195108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:03:28.195108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:03:28.196626 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_3e4289e377d24036b968d0ae71c61dcc", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3e4289e377d24036b968d0ae71c61dcc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/3e4289e377d24036b968d0ae71c61dcc"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/3e4289e377d24036b968d0ae71c61dcc"}]}] Jul 28 04:03:28.196626 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-VolumesSnapshotTestJSON-1815150758 Jul 28 04:03:28.196626 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 3e4289e377d24036b968d0ae71c61dcc Jul 28 04:03:28.196626 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1815150758 Jul 28 04:03:28.196626 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-VolumesSnapshotTestJSON-1815150758-project Jul 28 04:03:28.196626 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:03:28.196626 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:03:28.196626 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: 518ad5eb820e44aa9689215e6038a521 Jul 28 04:03:28.196626 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-VolumesSnapshotTestJSON-1815150758-project Jul 28 04:03:28.196626 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:03:28.196626 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Instance 13239a17-d303-4280-ad70-46aa4dd02950 could not be found. Jul 28 04:03:28.196626 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': '13239a17-d303-4280-ad70-46aa4dd02950'} Jul 28 04:03:28.197474 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:03:28.197474 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:28.197474 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:03:28.197474 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:03:28.197474 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:03:28.197474 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:03:28.197474 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:03:28.197474 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:03:28.197474 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:03:28.197474 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:03:28.197474 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 13239a17-d303-4280-ad70-46aa4dd02950 could not be found. Jul 28 04:03:28.197474 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:03:28.197474 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:03:28.197474 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:03:28.197474 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:28.197474 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:03:28.197474 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:03:28.197474 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:03:28.197474 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:03:28.197474 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:03:28.198956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:03:28.198956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:03:28.198956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:03:28.198956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:03:28.198956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:03:28.198956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:03:28.198956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:03:28.198956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 13239a17-d303-4280-ad70-46aa4dd02950 could not be found. Jul 28 04:03:28.198956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:03:28.198956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:03:28.198956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:03:28.198956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:28.198956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:03:28.198956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:03:28.198956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:03:28.198956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:03:28.198956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 13239a17-d303-4280-ad70-46aa4dd02950 could not be found. Jul 28 04:03:28.198956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:03:28.200277 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8c150755-ccdf-494e-b684-f82fe0cf74d5 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] Returning 404 to user: Instance 13239a17-d303-4280-ad70-46aa4dd02950 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:03:28.200277 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8c150755-ccdf-494e-b684-f82fe0cf74d5 tempest-VolumesSnapshotTestJSON-1815150758 tempest-VolumesSnapshotTestJSON-1815150758-project] 10.222.0.46 "GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950" status: 404 len: 111 microversion: 2.1 time: 0.031750 Jul 28 04:03:28.200277 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 274/496] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:28 2022] GET /compute/v2.1/servers/13239a17-d303-4280-ad70-46aa4dd02950 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:03:29.016192 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-e7c30e41-95ff-4f98-b6cf-ea5fadbf90a8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:29.016785 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-e7c30e41-95ff-4f98-b6cf-ea5fadbf90a8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:29.023823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e7c30e41-95ff-4f98-b6cf-ea5fadbf90a8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:29.024270 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e7c30e41-95ff-4f98-b6cf-ea5fadbf90a8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:29.025022 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e7c30e41-95ff-4f98-b6cf-ea5fadbf90a8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:29.025454 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e7c30e41-95ff-4f98-b6cf-ea5fadbf90a8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:29.155124 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-e7c30e41-95ff-4f98-b6cf-ea5fadbf90a8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:29.163833 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-e7c30e41-95ff-4f98-b6cf-ea5fadbf90a8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1676 microversion: 2.1 time: 0.151623 Jul 28 04:03:29.164397 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 223/497] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:29 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:29.863641 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5d10c06e-a2d3-45b9-ac92-bbc24f5fe4e7 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-535651668", "imageRef": "a0eec51c-83e9-420b-bcb9-20fe8dcf5321", "flavorRef": "452"}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:29.917631 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.network.neutron [None req-5d10c06e-a2d3-45b9-ac92-bbc24f5fe4e7 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] validate_networks() for None {{(pid=118187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:03:30.185506 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-d1e82bad-7810-4dfc-a0d6-7fa811fa204e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:30.186135 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-d1e82bad-7810-4dfc-a0d6-7fa811fa204e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:30.193256 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d1e82bad-7810-4dfc-a0d6-7fa811fa204e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:30.193708 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d1e82bad-7810-4dfc-a0d6-7fa811fa204e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:30.194490 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d1e82bad-7810-4dfc-a0d6-7fa811fa204e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:30.194957 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d1e82bad-7810-4dfc-a0d6-7fa811fa204e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:30.341468 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-d1e82bad-7810-4dfc-a0d6-7fa811fa204e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:30.349868 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-d1e82bad-7810-4dfc-a0d6-7fa811fa204e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1676 microversion: 2.1 time: 0.168266 Jul 28 04:03:30.350561 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 224/498] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:30 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1676 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:30.385347 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-5d10c06e-a2d3-45b9-ac92-bbc24f5fe4e7 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Flavor limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:03:30.385808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-5d10c06e-a2d3-45b9-ac92-bbc24f5fe4e7 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Image limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:03:30.386283 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-5d10c06e-a2d3-45b9-ac92-bbc24f5fe4e7 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Flavor pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:03:30.386695 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-5d10c06e-a2d3-45b9-ac92-bbc24f5fe4e7 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Image pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:03:30.387133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-5d10c06e-a2d3-45b9-ac92-bbc24f5fe4e7 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:03:30.396655 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5d10c06e-a2d3-45b9-ac92-bbc24f5fe4e7 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:30.397107 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5d10c06e-a2d3-45b9-ac92-bbc24f5fe4e7 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:30.397907 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5d10c06e-a2d3-45b9-ac92-bbc24f5fe4e7 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:30.398346 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5d10c06e-a2d3-45b9-ac92-bbc24f5fe4e7 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:30.415102 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-5d10c06e-a2d3-45b9-ac92-bbc24f5fe4e7 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Getting quotas for project 9c1e529b4a644299a617363fe78049eb. Resources: {'instances', 'cores', 'ram'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:03:30.419061 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-5d10c06e-a2d3-45b9-ac92-bbc24f5fe4e7 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Getting quotas for user 78ba6235b4fd4730a64345f87853c781 and project 9c1e529b4a644299a617363fe78049eb. Resources: {'instances', 'cores', 'ram'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:03:30.429762 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5d10c06e-a2d3-45b9-ac92-bbc24f5fe4e7 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Going to run 1 instances... {{(pid=118187) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:03:30.431990 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5d10c06e-a2d3-45b9-ac92-bbc24f5fe4e7 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] [instance: 0982f3c1-3389-457d-bd4b-eec27d51a58d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0eec51c-83e9-420b-bcb9-20fe8dcf5321',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:03:30.474182 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5d10c06e-a2d3-45b9-ac92-bbc24f5fe4e7 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.615024 Jul 28 04:03:30.474855 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 275/499] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 04:03:29 2022] POST /compute/v2.1/servers => generated 380 bytes in 616 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:03:30.485403 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c804467f-427c-42b2-b42d-98c5f70ec6f3 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:30.486065 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c804467f-427c-42b2-b42d-98c5f70ec6f3 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] [instance: 0982f3c1-3389-457d-bd4b-eec27d51a58d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:30.541718 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-c804467f-427c-42b2-b42d-98c5f70ec6f3 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ba6235b4fd4730a64345f87853c781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e529b4a644299a617363fe78049eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:30.548308 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-c804467f-427c-42b2-b42d-98c5f70ec6f3 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] 10.222.0.46 "GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d" status: 200 len: 1214 microversion: 2.1 time: 0.066665 Jul 28 04:03:30.549037 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 225/500] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:30 2022] GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:31.371605 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7d62b036-e740-4321-ada2-e6494090c634 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:31.372227 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7d62b036-e740-4321-ada2-e6494090c634 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:31.379809 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7d62b036-e740-4321-ada2-e6494090c634 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:31.380268 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7d62b036-e740-4321-ada2-e6494090c634 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:31.381070 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7d62b036-e740-4321-ada2-e6494090c634 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:31.381515 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7d62b036-e740-4321-ada2-e6494090c634 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:31.507110 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7d62b036-e740-4321-ada2-e6494090c634 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:31.514623 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7d62b036-e740-4321-ada2-e6494090c634 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1676 microversion: 2.1 time: 0.147442 Jul 28 04:03:31.515213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 276/501] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:31 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:31.569885 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-949c613c-b7b3-4b4a-a02c-f83474ebc2e5 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:31.570511 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-949c613c-b7b3-4b4a-a02c-f83474ebc2e5 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] [instance: 0982f3c1-3389-457d-bd4b-eec27d51a58d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:31.577579 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-949c613c-b7b3-4b4a-a02c-f83474ebc2e5 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:31.578034 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-949c613c-b7b3-4b4a-a02c-f83474ebc2e5 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:31.578820 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-949c613c-b7b3-4b4a-a02c-f83474ebc2e5 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:31.579267 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-949c613c-b7b3-4b4a-a02c-f83474ebc2e5 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:31.640128 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-949c613c-b7b3-4b4a-a02c-f83474ebc2e5 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ba6235b4fd4730a64345f87853c781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e529b4a644299a617363fe78049eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:31.647753 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-949c613c-b7b3-4b4a-a02c-f83474ebc2e5 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] 10.222.0.46 "GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d" status: 200 len: 1218 microversion: 2.1 time: 0.081723 Jul 28 04:03:31.648321 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 226/502] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:31 2022] GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d => generated 1218 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:32.536671 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b2852ad5-3904-4ddc-a4a7-b7da702ea688 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:32.537559 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b2852ad5-3904-4ddc-a4a7-b7da702ea688 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:32.544067 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b2852ad5-3904-4ddc-a4a7-b7da702ea688 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:32.544518 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b2852ad5-3904-4ddc-a4a7-b7da702ea688 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:32.545280 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b2852ad5-3904-4ddc-a4a7-b7da702ea688 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:32.545717 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b2852ad5-3904-4ddc-a4a7-b7da702ea688 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:32.668564 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-8a04bb39-caee-4b7e-b57a-8beef11a5fea tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:32.669186 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-8a04bb39-caee-4b7e-b57a-8beef11a5fea tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] [instance: 0982f3c1-3389-457d-bd4b-eec27d51a58d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:32.676329 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8a04bb39-caee-4b7e-b57a-8beef11a5fea tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:32.676780 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8a04bb39-caee-4b7e-b57a-8beef11a5fea tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:32.677557 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8a04bb39-caee-4b7e-b57a-8beef11a5fea tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:32.677992 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8a04bb39-caee-4b7e-b57a-8beef11a5fea tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:32.678433 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b2852ad5-3904-4ddc-a4a7-b7da702ea688 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:32.686821 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b2852ad5-3904-4ddc-a4a7-b7da702ea688 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1676 microversion: 2.1 time: 0.154395 Jul 28 04:03:32.687463 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 277/503] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:32 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:32.740118 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-8a04bb39-caee-4b7e-b57a-8beef11a5fea tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ba6235b4fd4730a64345f87853c781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e529b4a644299a617363fe78049eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:32.747526 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-8a04bb39-caee-4b7e-b57a-8beef11a5fea tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] 10.222.0.46 "GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d" status: 200 len: 1218 microversion: 2.1 time: 0.082749 Jul 28 04:03:32.748093 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 227/504] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:32 2022] GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:33.708807 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6bbe3dd5-42b2-48cc-8cd3-70a69962bef7 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:33.709421 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6bbe3dd5-42b2-48cc-8cd3-70a69962bef7 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:33.716155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6bbe3dd5-42b2-48cc-8cd3-70a69962bef7 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:33.716427 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6bbe3dd5-42b2-48cc-8cd3-70a69962bef7 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:33.717188 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6bbe3dd5-42b2-48cc-8cd3-70a69962bef7 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:33.717619 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6bbe3dd5-42b2-48cc-8cd3-70a69962bef7 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:33.768824 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-94b0c2a8-748a-449a-b9cf-ab91e391186e tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:33.770146 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-94b0c2a8-748a-449a-b9cf-ab91e391186e tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] [instance: 0982f3c1-3389-457d-bd4b-eec27d51a58d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:33.777659 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-94b0c2a8-748a-449a-b9cf-ab91e391186e tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:33.778182 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-94b0c2a8-748a-449a-b9cf-ab91e391186e tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:33.779088 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-94b0c2a8-748a-449a-b9cf-ab91e391186e tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:33.779850 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-94b0c2a8-748a-449a-b9cf-ab91e391186e tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:33.856929 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-94b0c2a8-748a-449a-b9cf-ab91e391186e tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ba6235b4fd4730a64345f87853c781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e529b4a644299a617363fe78049eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:33.866248 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-94b0c2a8-748a-449a-b9cf-ab91e391186e tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] 10.222.0.46 "GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d" status: 200 len: 1266 microversion: 2.1 time: 0.102328 Jul 28 04:03:33.867203 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 228/505] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:33 2022] GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d => generated 1266 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:33.868509 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6bbe3dd5-42b2-48cc-8cd3-70a69962bef7 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:33.882581 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6bbe3dd5-42b2-48cc-8cd3-70a69962bef7 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1676 microversion: 2.1 time: 0.177776 Jul 28 04:03:33.883195 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 278/506] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:33 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1676 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:34.889872 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-e2a13fb2-40c5-4992-9481-f6a311ee87ae tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:34.890638 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-e2a13fb2-40c5-4992-9481-f6a311ee87ae tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] [instance: 0982f3c1-3389-457d-bd4b-eec27d51a58d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:34.897353 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e2a13fb2-40c5-4992-9481-f6a311ee87ae tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:34.897800 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e2a13fb2-40c5-4992-9481-f6a311ee87ae tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:34.898772 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e2a13fb2-40c5-4992-9481-f6a311ee87ae tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:34.899553 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e2a13fb2-40c5-4992-9481-f6a311ee87ae tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:34.904471 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ebdf3248-e573-47ec-bc48-0a82f42f2933 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:34.906309 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ebdf3248-e573-47ec-bc48-0a82f42f2933 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:34.914497 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ebdf3248-e573-47ec-bc48-0a82f42f2933 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:34.915284 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ebdf3248-e573-47ec-bc48-0a82f42f2933 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:34.916277 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ebdf3248-e573-47ec-bc48-0a82f42f2933 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:34.916906 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ebdf3248-e573-47ec-bc48-0a82f42f2933 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:35.061330 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ebdf3248-e573-47ec-bc48-0a82f42f2933 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:35.070111 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ebdf3248-e573-47ec-bc48-0a82f42f2933 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1676 microversion: 2.1 time: 0.169522 Jul 28 04:03:35.070872 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 279/507] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:34 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1676 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:35.075824 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d4c2ec43-e5e1-4c87-b82c-93af6a70d5e5 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-878883424", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1551827242", "security_groups": [{"name": "tempest-secgroup-smoke-15930751"}], "block_device_mapping_v2": [{"uuid": "3aa14d38-16eb-4031-a2b9-ddbaf41ee57b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1c80a3f8-351e-4afc-86dc-eff91807353a"}]}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:35.193990 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.network.neutron [None req-d4c2ec43-e5e1-4c87-b82c-93af6a70d5e5 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] validate_networks() for [('1c80a3f8-351e-4afc-86dc-eff91807353a', None, None, None, None, None)] {{(pid=118187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:03:35.265061 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-e2a13fb2-40c5-4992-9481-f6a311ee87ae tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ba6235b4fd4730a64345f87853c781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e529b4a644299a617363fe78049eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:35.276688 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-e2a13fb2-40c5-4992-9481-f6a311ee87ae tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] 10.222.0.46 "GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d" status: 200 len: 1272 microversion: 2.1 time: 0.391241 Jul 28 04:03:35.278248 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 229/508] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:34 2022] GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d => generated 1272 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:35.615820 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-d4c2ec43-e5e1-4c87-b82c-93af6a70d5e5 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Flavor limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:03:35.616299 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-d4c2ec43-e5e1-4c87-b82c-93af6a70d5e5 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Image limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:03:35.616776 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-d4c2ec43-e5e1-4c87-b82c-93af6a70d5e5 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Flavor pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:03:35.617185 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-d4c2ec43-e5e1-4c87-b82c-93af6a70d5e5 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Image pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:03:35.617782 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-d4c2ec43-e5e1-4c87-b82c-93af6a70d5e5 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:03:35.631238 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d4c2ec43-e5e1-4c87-b82c-93af6a70d5e5 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:35.631694 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d4c2ec43-e5e1-4c87-b82c-93af6a70d5e5 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:35.632642 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d4c2ec43-e5e1-4c87-b82c-93af6a70d5e5 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:35.632948 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d4c2ec43-e5e1-4c87-b82c-93af6a70d5e5 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:35.654466 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-d4c2ec43-e5e1-4c87-b82c-93af6a70d5e5 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Getting quotas for project 338679f381ed4e9e898a59289b0f8178. Resources: {'instances', 'cores', 'ram'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:03:35.659726 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-d4c2ec43-e5e1-4c87-b82c-93af6a70d5e5 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Getting quotas for user 352d60372ba249e38ea4aa2d62723f19 and project 338679f381ed4e9e898a59289b0f8178. Resources: {'instances', 'cores', 'ram'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:03:35.731239 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d4c2ec43-e5e1-4c87-b82c-93af6a70d5e5 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Going to run 1 instances... {{(pid=118187) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:03:35.733252 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d4c2ec43-e5e1-4c87-b82c-93af6a70d5e5 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3aa14d38-16eb-4031-a2b9-ddbaf41ee57b',volume_size=None,volume_type=None)] {{(pid=118187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:03:35.876440 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d4c2ec43-e5e1-4c87-b82c-93af6a70d5e5 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.804258 Jul 28 04:03:35.877358 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 280/509] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 04:03:35 2022] POST /compute/v2.1/servers => generated 404 bytes in 806 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:03:35.888256 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-eca2114f-4c4b-4171-bf68-7be4d5e900e2 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:35.889268 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-eca2114f-4c4b-4171-bf68-7be4d5e900e2 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:36.011349 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-eca2114f-4c4b-4171-bf68-7be4d5e900e2 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:36.020980 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-eca2114f-4c4b-4171-bf68-7be4d5e900e2 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 200 len: 1094 microversion: 2.1 time: 0.136536 Jul 28 04:03:36.021561 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 230/510] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:35 2022] GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 1094 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:36.091988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-885fba22-75e1-4db5-8db8-15f00c4f6553 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:36.092618 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-885fba22-75e1-4db5-8db8-15f00c4f6553 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:36.100475 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-885fba22-75e1-4db5-8db8-15f00c4f6553 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:36.100938 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-885fba22-75e1-4db5-8db8-15f00c4f6553 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:36.101724 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-885fba22-75e1-4db5-8db8-15f00c4f6553 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:36.102167 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-885fba22-75e1-4db5-8db8-15f00c4f6553 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:36.249095 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-885fba22-75e1-4db5-8db8-15f00c4f6553 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:36.259373 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-885fba22-75e1-4db5-8db8-15f00c4f6553 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1676 microversion: 2.1 time: 0.170902 Jul 28 04:03:36.272721 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 281/511] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:36 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1676 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:36.297797 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-d567a85a-6c68-4b1e-8029-8327d24a6659 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:36.299587 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-d567a85a-6c68-4b1e-8029-8327d24a6659 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] [instance: 0982f3c1-3389-457d-bd4b-eec27d51a58d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:36.306970 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d567a85a-6c68-4b1e-8029-8327d24a6659 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:36.307419 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d567a85a-6c68-4b1e-8029-8327d24a6659 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:36.308190 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d567a85a-6c68-4b1e-8029-8327d24a6659 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:36.308624 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d567a85a-6c68-4b1e-8029-8327d24a6659 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:36.534441 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-d567a85a-6c68-4b1e-8029-8327d24a6659 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ba6235b4fd4730a64345f87853c781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e529b4a644299a617363fe78049eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:36.544908 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-d567a85a-6c68-4b1e-8029-8327d24a6659 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] 10.222.0.46 "GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d" status: 200 len: 1314 microversion: 2.1 time: 0.250842 Jul 28 04:03:36.555786 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 231/512] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:36 2022] GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d => generated 1314 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:36.652187 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-e2994c6a-c3f4-48a0-8e3c-dbb2a494e98e req-7628ff9f-660e-4e5d-a2bb-f73f9307797b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0982f3c1-3389-457d-bd4b-eec27d51a58d", "tag": "65f322e7-3a40-40ac-8264-2e03dc6493c6"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:36.669396 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-e2994c6a-c3f4-48a0-8e3c-dbb2a494e98e req-7628ff9f-660e-4e5d-a2bb-f73f9307797b service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:36.669957 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-e2994c6a-c3f4-48a0-8e3c-dbb2a494e98e req-7628ff9f-660e-4e5d-a2bb-f73f9307797b service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:36.687270 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-e2994c6a-c3f4-48a0-8e3c-dbb2a494e98e req-7628ff9f-660e-4e5d-a2bb-f73f9307797b service nova] Creating event network-changed:65f322e7-3a40-40ac-8264-2e03dc6493c6 for instance 0982f3c1-3389-457d-bd4b-eec27d51a58d on hv-cinder-79987 Jul 28 04:03:36.694672 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-e2994c6a-c3f4-48a0-8e3c-dbb2a494e98e req-7628ff9f-660e-4e5d-a2bb-f73f9307797b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048728 Jul 28 04:03:36.695758 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 282/513] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:37.041825 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-27310ce0-cf15-45d3-a615-a15fe466d2c1 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:37.042448 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-27310ce0-cf15-45d3-a615-a15fe466d2c1 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:37.049805 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-27310ce0-cf15-45d3-a615-a15fe466d2c1 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:37.050649 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-27310ce0-cf15-45d3-a615-a15fe466d2c1 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:37.051779 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-27310ce0-cf15-45d3-a615-a15fe466d2c1 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:37.052235 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-27310ce0-cf15-45d3-a615-a15fe466d2c1 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:37.120460 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-27310ce0-cf15-45d3-a615-a15fe466d2c1 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:37.124067 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:37.130275 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-27310ce0-cf15-45d3-a615-a15fe466d2c1 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 200 len: 1192 microversion: 2.1 time: 0.092294 Jul 28 04:03:37.130880 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 232/514] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:37 2022] GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 1192 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:37.282536 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-78b8efc8-9b18-4442-9db2-040664f33bf2 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:37.283263 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-78b8efc8-9b18-4442-9db2-040664f33bf2 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:37.290612 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-78b8efc8-9b18-4442-9db2-040664f33bf2 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:37.291209 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-78b8efc8-9b18-4442-9db2-040664f33bf2 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:37.291980 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-78b8efc8-9b18-4442-9db2-040664f33bf2 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:37.292421 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-78b8efc8-9b18-4442-9db2-040664f33bf2 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:37.443317 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-78b8efc8-9b18-4442-9db2-040664f33bf2 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:37.450978 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-78b8efc8-9b18-4442-9db2-040664f33bf2 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1676 microversion: 2.1 time: 0.173115 Jul 28 04:03:37.451550 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 283/515] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:37 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1676 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:37.572785 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-d5d51dce-d890-44d4-86d7-f33d4a87d499 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:37.573410 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-d5d51dce-d890-44d4-86d7-f33d4a87d499 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] [instance: 0982f3c1-3389-457d-bd4b-eec27d51a58d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:37.580935 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d5d51dce-d890-44d4-86d7-f33d4a87d499 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:37.581392 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d5d51dce-d890-44d4-86d7-f33d4a87d499 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:37.582152 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d5d51dce-d890-44d4-86d7-f33d4a87d499 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:37.582582 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d5d51dce-d890-44d4-86d7-f33d4a87d499 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:37.801214 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-d5d51dce-d890-44d4-86d7-f33d4a87d499 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ba6235b4fd4730a64345f87853c781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e529b4a644299a617363fe78049eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:37.808571 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-d5d51dce-d890-44d4-86d7-f33d4a87d499 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] 10.222.0.46 "GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d" status: 200 len: 1314 microversion: 2.1 time: 0.239669 Jul 28 04:03:37.809140 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 233/516] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:37 2022] GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:38.152538 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a7183faa-50c8-4a03-abc7-c3de0bd8fb7a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:38.153477 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a7183faa-50c8-4a03-abc7-c3de0bd8fb7a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:38.160682 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7183faa-50c8-4a03-abc7-c3de0bd8fb7a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:38.161439 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7183faa-50c8-4a03-abc7-c3de0bd8fb7a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:38.162557 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7183faa-50c8-4a03-abc7-c3de0bd8fb7a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:38.163105 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7183faa-50c8-4a03-abc7-c3de0bd8fb7a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:38.183315 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:38.300439 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a7183faa-50c8-4a03-abc7-c3de0bd8fb7a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:38.308165 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a7183faa-50c8-4a03-abc7-c3de0bd8fb7a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 200 len: 1276 microversion: 2.1 time: 0.159610 Jul 28 04:03:38.308939 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 284/517] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:38 2022] GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 1276 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:38.472978 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-3d997f43-2754-4faa-a2ae-b5c07c86cdfa tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:38.473591 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-3d997f43-2754-4faa-a2ae-b5c07c86cdfa tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:38.480476 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3d997f43-2754-4faa-a2ae-b5c07c86cdfa tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:38.480925 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3d997f43-2754-4faa-a2ae-b5c07c86cdfa tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:38.481697 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3d997f43-2754-4faa-a2ae-b5c07c86cdfa tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:38.482211 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3d997f43-2754-4faa-a2ae-b5c07c86cdfa tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:38.617321 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-3d997f43-2754-4faa-a2ae-b5c07c86cdfa tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:38.624752 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-3d997f43-2754-4faa-a2ae-b5c07c86cdfa tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1676 microversion: 2.1 time: 0.156363 Jul 28 04:03:38.625330 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 234/518] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:38 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:38.829632 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-71c7e880-34da-4cf1-90be-b6eb0d79e0d4 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:38.830423 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-71c7e880-34da-4cf1-90be-b6eb0d79e0d4 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] [instance: 0982f3c1-3389-457d-bd4b-eec27d51a58d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:38.836527 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-71c7e880-34da-4cf1-90be-b6eb0d79e0d4 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:38.836982 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-71c7e880-34da-4cf1-90be-b6eb0d79e0d4 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:38.837741 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-71c7e880-34da-4cf1-90be-b6eb0d79e0d4 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:38.838180 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-71c7e880-34da-4cf1-90be-b6eb0d79e0d4 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:38.971647 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-71c7e880-34da-4cf1-90be-b6eb0d79e0d4 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ba6235b4fd4730a64345f87853c781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e529b4a644299a617363fe78049eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:38.979209 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-71c7e880-34da-4cf1-90be-b6eb0d79e0d4 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] 10.222.0.46 "GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d" status: 200 len: 1314 microversion: 2.1 time: 0.153373 Jul 28 04:03:38.979774 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 285/519] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:38 2022] GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:39.328318 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-ee7a0968-6dd8-4ae9-b48d-69c8a14cc861 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:39.328961 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-ee7a0968-6dd8-4ae9-b48d-69c8a14cc861 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:39.335915 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ee7a0968-6dd8-4ae9-b48d-69c8a14cc861 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:39.336365 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ee7a0968-6dd8-4ae9-b48d-69c8a14cc861 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:39.337126 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ee7a0968-6dd8-4ae9-b48d-69c8a14cc861 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:39.337560 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ee7a0968-6dd8-4ae9-b48d-69c8a14cc861 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:39.467740 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-ee7a0968-6dd8-4ae9-b48d-69c8a14cc861 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:39.475057 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-ee7a0968-6dd8-4ae9-b48d-69c8a14cc861 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 200 len: 1276 microversion: 2.1 time: 0.150558 Jul 28 04:03:39.475639 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 235/520] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:39 2022] GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 1276 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:39.646421 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-55f8c985-099b-429b-8e64-a3f7ca3938b1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:39.647080 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-55f8c985-099b-429b-8e64-a3f7ca3938b1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:39.653608 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55f8c985-099b-429b-8e64-a3f7ca3938b1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:39.654066 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55f8c985-099b-429b-8e64-a3f7ca3938b1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:39.654856 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55f8c985-099b-429b-8e64-a3f7ca3938b1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:39.655301 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55f8c985-099b-429b-8e64-a3f7ca3938b1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:39.784168 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-55f8c985-099b-429b-8e64-a3f7ca3938b1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:39.791956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-55f8c985-099b-429b-8e64-a3f7ca3938b1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1676 microversion: 2.1 time: 0.149503 Jul 28 04:03:39.792530 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 286/521] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:39 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:40.000449 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-3dc425e3-9747-4b1b-88e9-45b9265b75e1 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:40.000985 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-3dc425e3-9747-4b1b-88e9-45b9265b75e1 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] [instance: 0982f3c1-3389-457d-bd4b-eec27d51a58d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:40.007706 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3dc425e3-9747-4b1b-88e9-45b9265b75e1 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:40.008150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3dc425e3-9747-4b1b-88e9-45b9265b75e1 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:40.008904 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3dc425e3-9747-4b1b-88e9-45b9265b75e1 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:40.009338 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3dc425e3-9747-4b1b-88e9-45b9265b75e1 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:40.140297 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-3dc425e3-9747-4b1b-88e9-45b9265b75e1 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ba6235b4fd4730a64345f87853c781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e529b4a644299a617363fe78049eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:40.147985 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-3dc425e3-9747-4b1b-88e9-45b9265b75e1 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] 10.222.0.46 "GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d" status: 200 len: 1314 microversion: 2.1 time: 0.151482 Jul 28 04:03:40.148615 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 236/522] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:39 2022] GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:40.495211 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f9b14091-4a91-4011-b912-408c6a3a64f7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:40.495828 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f9b14091-4a91-4011-b912-408c6a3a64f7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:40.502402 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f9b14091-4a91-4011-b912-408c6a3a64f7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:40.502887 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f9b14091-4a91-4011-b912-408c6a3a64f7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:40.503651 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f9b14091-4a91-4011-b912-408c6a3a64f7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:40.504089 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f9b14091-4a91-4011-b912-408c6a3a64f7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:40.633215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f9b14091-4a91-4011-b912-408c6a3a64f7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:40.640640 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f9b14091-4a91-4011-b912-408c6a3a64f7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 200 len: 1276 microversion: 2.1 time: 0.149269 Jul 28 04:03:40.641201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 287/523] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:40 2022] GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 1276 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:40.812690 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-031ddb35-43fd-48cc-80da-fe5dabfad694 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:40.813308 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-031ddb35-43fd-48cc-80da-fe5dabfad694 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:40.819930 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-031ddb35-43fd-48cc-80da-fe5dabfad694 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:40.820385 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-031ddb35-43fd-48cc-80da-fe5dabfad694 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:40.821150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-031ddb35-43fd-48cc-80da-fe5dabfad694 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:40.821591 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-031ddb35-43fd-48cc-80da-fe5dabfad694 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:40.952050 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-031ddb35-43fd-48cc-80da-fe5dabfad694 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:40.960183 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-031ddb35-43fd-48cc-80da-fe5dabfad694 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1676 microversion: 2.1 time: 0.151336 Jul 28 04:03:40.960754 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 237/524] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:40 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:41.168982 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-231d13e4-3d38-4e6e-a671-196798e7fe8c tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:41.169751 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-231d13e4-3d38-4e6e-a671-196798e7fe8c tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] [instance: 0982f3c1-3389-457d-bd4b-eec27d51a58d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:41.177102 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-231d13e4-3d38-4e6e-a671-196798e7fe8c tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:41.177553 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-231d13e4-3d38-4e6e-a671-196798e7fe8c tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:41.183834 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-231d13e4-3d38-4e6e-a671-196798e7fe8c tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:41.184293 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-231d13e4-3d38-4e6e-a671-196798e7fe8c tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:41.322840 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-231d13e4-3d38-4e6e-a671-196798e7fe8c tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ba6235b4fd4730a64345f87853c781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e529b4a644299a617363fe78049eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:41.330846 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-231d13e4-3d38-4e6e-a671-196798e7fe8c tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] 10.222.0.46 "GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d" status: 200 len: 1314 microversion: 2.1 time: 0.165121 Jul 28 04:03:41.331649 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 288/525] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:41 2022] GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:41.663930 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-d5c652b0-46e8-4a88-992c-08adb55981a7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:41.664561 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-d5c652b0-46e8-4a88-992c-08adb55981a7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:41.674187 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d5c652b0-46e8-4a88-992c-08adb55981a7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:41.675386 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d5c652b0-46e8-4a88-992c-08adb55981a7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:41.676539 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d5c652b0-46e8-4a88-992c-08adb55981a7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:41.677193 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d5c652b0-46e8-4a88-992c-08adb55981a7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:41.980575 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7715bed0-37b2-44b4-9007-ed9720e46dc3 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:41.981323 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7715bed0-37b2-44b4-9007-ed9720e46dc3 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:41.987976 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7715bed0-37b2-44b4-9007-ed9720e46dc3 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:41.988430 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7715bed0-37b2-44b4-9007-ed9720e46dc3 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:41.989230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7715bed0-37b2-44b4-9007-ed9720e46dc3 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:41.989673 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7715bed0-37b2-44b4-9007-ed9720e46dc3 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:42.009760 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-d5c652b0-46e8-4a88-992c-08adb55981a7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:42.017709 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-d5c652b0-46e8-4a88-992c-08adb55981a7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 200 len: 1276 microversion: 2.1 time: 0.359740 Jul 28 04:03:42.019245 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 238/526] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:41 2022] GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 1276 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:42.121681 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7715bed0-37b2-44b4-9007-ed9720e46dc3 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:42.130774 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7715bed0-37b2-44b4-9007-ed9720e46dc3 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1653 microversion: 2.1 time: 0.153979 Jul 28 04:03:42.131434 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 289/527] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:41 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1653 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:42.152243 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-4c00f2d1-f1ed-4520-b221-06625c4ee551 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:42.158494 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4c00f2d1-f1ed-4520-b221-06625c4ee551 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:42.159008 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4c00f2d1-f1ed-4520-b221-06625c4ee551 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:42.182952 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-4c00f2d1-f1ed-4520-b221-06625c4ee551 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Going to try to start instance {{(pid=118186) start /opt/stack/nova/nova/compute/api.py:2733}} Jul 28 04:03:42.242361 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-4c00f2d1-f1ed-4520-b221-06625c4ee551 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "POST /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475/action" status: 202 len: 0 microversion: 2.1 time: 0.093971 Jul 28 04:03:42.243103 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 239/528] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Jul 28 04:03:42 2022] POST /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:03:42.258865 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-08d8a865-e6c2-4be5-a838-d41e9262d4d0 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:42.260162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-08d8a865-e6c2-4be5-a838-d41e9262d4d0 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:42.272182 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-08d8a865-e6c2-4be5-a838-d41e9262d4d0 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:42.272992 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-08d8a865-e6c2-4be5-a838-d41e9262d4d0 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:42.275149 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-08d8a865-e6c2-4be5-a838-d41e9262d4d0 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:42.275895 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-08d8a865-e6c2-4be5-a838-d41e9262d4d0 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:42.354804 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c1a1f22b-7e9f-4493-9d8a-9251f2da201a tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:42.356570 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c1a1f22b-7e9f-4493-9d8a-9251f2da201a tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] [instance: 0982f3c1-3389-457d-bd4b-eec27d51a58d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:42.369463 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c1a1f22b-7e9f-4493-9d8a-9251f2da201a tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:42.371397 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c1a1f22b-7e9f-4493-9d8a-9251f2da201a tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:42.372294 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c1a1f22b-7e9f-4493-9d8a-9251f2da201a tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:42.374144 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c1a1f22b-7e9f-4493-9d8a-9251f2da201a tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:42.505996 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-08d8a865-e6c2-4be5-a838-d41e9262d4d0 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:42.514920 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-08d8a865-e6c2-4be5-a838-d41e9262d4d0 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1662 microversion: 2.1 time: 0.264714 Jul 28 04:03:42.516020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 290/529] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:42 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1662 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:43.040567 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5c5b9e96-4b3c-42a4-89b5-512eb9688b07 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:43.041188 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5c5b9e96-4b3c-42a4-89b5-512eb9688b07 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:43.047614 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5c5b9e96-4b3c-42a4-89b5-512eb9688b07 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:43.048061 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5c5b9e96-4b3c-42a4-89b5-512eb9688b07 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:43.048969 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5c5b9e96-4b3c-42a4-89b5-512eb9688b07 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:43.049444 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5c5b9e96-4b3c-42a4-89b5-512eb9688b07 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:43.138160 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-c1a1f22b-7e9f-4493-9d8a-9251f2da201a tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ba6235b4fd4730a64345f87853c781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e529b4a644299a617363fe78049eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:43.152337 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-c1a1f22b-7e9f-4493-9d8a-9251f2da201a tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] 10.222.0.46 "GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d" status: 200 len: 1314 microversion: 2.1 time: 0.802568 Jul 28 04:03:43.166610 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 240/530] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:42 2022] GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d => generated 1314 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:43.200865 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5c5b9e96-4b3c-42a4-89b5-512eb9688b07 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:43.209678 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5c5b9e96-4b3c-42a4-89b5-512eb9688b07 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 200 len: 1264 microversion: 2.1 time: 0.173653 Jul 28 04:03:43.210877 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 291/531] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:43 2022] GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:43.314760 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-431db8a1-6414-4150-a822-56a9f368ce49 req-2d7639c0-2358-4394-b46e-cb0b37fbb937 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b73f1a1-e07f-4ebe-af69-e188924a9073", "tag": "8f78dd8c-353e-4f87-bef6-e8bc130d65a0"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:43.324474 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-3f6a739e-ae02-44f3-8865-af12e09c24bc req-04b23018-eec3-46e0-be68-b78bbcbd6f8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0982f3c1-3389-457d-bd4b-eec27d51a58d", "name": "network-vif-plugged", "status": "completed", "tag": "65f322e7-3a40-40ac-8264-2e03dc6493c6"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:43.374427 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-431db8a1-6414-4150-a822-56a9f368ce49 req-2d7639c0-2358-4394-b46e-cb0b37fbb937 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:43.374929 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-431db8a1-6414-4150-a822-56a9f368ce49 req-2d7639c0-2358-4394-b46e-cb0b37fbb937 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:43.380045 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-3f6a739e-ae02-44f3-8865-af12e09c24bc req-04b23018-eec3-46e0-be68-b78bbcbd6f8a service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:43.380516 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-3f6a739e-ae02-44f3-8865-af12e09c24bc req-04b23018-eec3-46e0-be68-b78bbcbd6f8a service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:43.398016 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-431db8a1-6414-4150-a822-56a9f368ce49 req-2d7639c0-2358-4394-b46e-cb0b37fbb937 service nova] Creating event network-changed:8f78dd8c-353e-4f87-bef6-e8bc130d65a0 for instance 5b73f1a1-e07f-4ebe-af69-e188924a9073 on hv-cinder-79987 Jul 28 04:03:43.400245 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-3f6a739e-ae02-44f3-8865-af12e09c24bc req-04b23018-eec3-46e0-be68-b78bbcbd6f8a service nova] Creating event network-vif-plugged:65f322e7-3a40-40ac-8264-2e03dc6493c6 for instance 0982f3c1-3389-457d-bd4b-eec27d51a58d on hv-cinder-79987 Jul 28 04:03:43.403045 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-431db8a1-6414-4150-a822-56a9f368ce49 req-2d7639c0-2358-4394-b46e-cb0b37fbb937 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.114192 Jul 28 04:03:43.404824 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 241/532] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:43.406307 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-3f6a739e-ae02-44f3-8865-af12e09c24bc req-04b23018-eec3-46e0-be68-b78bbcbd6f8a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107250 Jul 28 04:03:43.407241 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 292/533] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:03:43.540380 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-4ecf4f1b-b690-4add-8ee2-7c8cae23c8b1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:43.541885 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-4ecf4f1b-b690-4add-8ee2-7c8cae23c8b1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:43.548497 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4ecf4f1b-b690-4add-8ee2-7c8cae23c8b1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:43.548943 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4ecf4f1b-b690-4add-8ee2-7c8cae23c8b1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:43.550191 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4ecf4f1b-b690-4add-8ee2-7c8cae23c8b1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:43.550831 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4ecf4f1b-b690-4add-8ee2-7c8cae23c8b1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:43.934425 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-4ecf4f1b-b690-4add-8ee2-7c8cae23c8b1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:43.942955 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-4ecf4f1b-b690-4add-8ee2-7c8cae23c8b1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1662 microversion: 2.1 time: 0.409460 Jul 28 04:03:43.943563 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 242/534] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:43 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1662 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:44.174768 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8abfd54f-2f1a-489e-a23b-09646a2d5ccf tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:44.175501 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8abfd54f-2f1a-489e-a23b-09646a2d5ccf tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] [instance: 0982f3c1-3389-457d-bd4b-eec27d51a58d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:44.181685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8abfd54f-2f1a-489e-a23b-09646a2d5ccf tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:44.182140 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8abfd54f-2f1a-489e-a23b-09646a2d5ccf tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:44.182936 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8abfd54f-2f1a-489e-a23b-09646a2d5ccf tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:44.183376 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8abfd54f-2f1a-489e-a23b-09646a2d5ccf tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:44.231734 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-2cefbec8-5454-401c-a67e-714228d99cad tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:44.232440 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-2cefbec8-5454-401c-a67e-714228d99cad tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:44.239816 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2cefbec8-5454-401c-a67e-714228d99cad tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:44.240216 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2cefbec8-5454-401c-a67e-714228d99cad tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:44.241001 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2cefbec8-5454-401c-a67e-714228d99cad tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:44.241441 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2cefbec8-5454-401c-a67e-714228d99cad tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:44.318239 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8abfd54f-2f1a-489e-a23b-09646a2d5ccf tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ba6235b4fd4730a64345f87853c781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e529b4a644299a617363fe78049eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:44.325702 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8abfd54f-2f1a-489e-a23b-09646a2d5ccf tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] 10.222.0.46 "GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d" status: 200 len: 1314 microversion: 2.1 time: 0.155728 Jul 28 04:03:44.326316 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 293/535] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:44 2022] GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:44.380975 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-2cefbec8-5454-401c-a67e-714228d99cad tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:44.388555 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-2cefbec8-5454-401c-a67e-714228d99cad tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 200 len: 1264 microversion: 2.1 time: 0.161957 Jul 28 04:03:44.389121 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 243/536] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:44 2022] GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:44.903029 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-08788d09-f64f-4564-b6a5-9d010b692ffb tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:44.903519 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-08788d09-f64f-4564-b6a5-9d010b692ffb tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:44.910490 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-08788d09-f64f-4564-b6a5-9d010b692ffb tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:44.910967 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-08788d09-f64f-4564-b6a5-9d010b692ffb tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:44.911728 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-08788d09-f64f-4564-b6a5-9d010b692ffb tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:44.912413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-08788d09-f64f-4564-b6a5-9d010b692ffb tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:44.936577 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-08788d09-f64f-4564-b6a5-9d010b692ffb tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0/ips" status: 200 len: 150 microversion: 2.1 time: 0.037380 Jul 28 04:03:44.937162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 294/537] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Jul 28 04:03:44 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:44.949189 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-dd583445-6f0b-4084-9d49-ee8cde7631c9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "558124de-09db-4b0a-8047-6a2c4c25da51"}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:44.951620 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-dd583445-6f0b-4084-9d49-ee8cde7631c9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:44.959641 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dd583445-6f0b-4084-9d49-ee8cde7631c9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:44.960087 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dd583445-6f0b-4084-9d49-ee8cde7631c9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:44.960869 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dd583445-6f0b-4084-9d49-ee8cde7631c9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:44.961301 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dd583445-6f0b-4084-9d49-ee8cde7631c9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:44.964642 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e7ad1407-5700-48a4-98ed-2cb22d8927b4 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:44.965483 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e7ad1407-5700-48a4-98ed-2cb22d8927b4 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:44.972229 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e7ad1407-5700-48a4-98ed-2cb22d8927b4 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:44.972686 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e7ad1407-5700-48a4-98ed-2cb22d8927b4 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:44.973459 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e7ad1407-5700-48a4-98ed-2cb22d8927b4 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:44.973901 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e7ad1407-5700-48a4-98ed-2cb22d8927b4 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:45.048659 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.wsgi [None req-dd583445-6f0b-4084-9d49-ee8cde7631c9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] HTTP exception thrown: Invalid volume: volume 558124de-09db-4b0a-8047-6a2c4c25da51 is already attached to instances: f9103b14-a0f8-40f5-b38b-54b90cae2131 Jul 28 04:03:45.051717 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-dd583445-6f0b-4084-9d49-ee8cde7631c9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Request method failure captured: Jul 28 04:03:45.051717 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: request: POST /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0/os-volume_attachments HTTP/1.1 Jul 28 04:03:45.051717 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept: application/json Jul 28 04:03:45.051717 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept-Encoding: identity Jul 28 04:03:45.051717 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Connection: close Jul 28 04:03:45.051717 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Length: 74 Jul 28 04:03:45.051717 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Type: application/json Jul 28 04:03:45.051717 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Host: 10.222.0.46 Jul 28 04:03:45.051717 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Openstack-System-Scope: None Jul 28 04:03:45.051717 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: User-Agent: python-urllib3/1.26.10 Jul 28 04:03:45.051717 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Auth-Token: gAAAAABi4gmoXQtNoyNZeVOBtHeH0p0IZl6gLmXu7uMplYaqMcIU3TXk6NAztCb7-3xvXPbqffriel8JQiqKAHgD2FYfvE1RoXCiUMTvpIZjixGVtBiBXhQr6lOIK0tmH4bMvCgHENHbbkhJpWpz1XJYt5CJBH3JqJi5ypO8pp_YsE0VFSnKOUI Jul 28 04:03:45.051717 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Id: None Jul 28 04:03:45.051717 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Name: None Jul 28 04:03:45.051717 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Identity-Status: Confirmed Jul 28 04:03:45.051717 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Is-Admin-Project: True Jul 28 04:03:45.051717 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Id: default Jul 28 04:03:45.051717 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Name: Default Jul 28 04:03:45.051717 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:03:45.051717 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:03:45.051717 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Role: reader,member Jul 28 04:03:45.051717 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Roles: reader,member Jul 28 04:03:45.053124 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_18a927e9f5da42d7b34752c8b2db211a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/18a927e9f5da42d7b34752c8b2db211a"}]}] Jul 28 04:03:45.053124 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:03:45.053124 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:03:45.053124 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:03:45.053124 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:03:45.053124 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Id: default Jul 28 04:03:45.053124 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Name: Default Jul 28 04:03:45.053124 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Id: c3308761e9d2495e95e127bbc7b9c5e2 Jul 28 04:03:45.053124 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Name: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:03:45.053124 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Jul 28 04:03:45.053124 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: {"volumeAttachment": {"volumeId": "558124de-09db-4b0a-8047-6a2c4c25da51"}} Jul 28 04:03:45.053124 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: method: > Jul 28 04:03:45.054247 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: exception: Invalid volume: volume 558124de-09db-4b0a-8047-6a2c4c25da51 is already attached to instances: f9103b14-a0f8-40f5-b38b-54b90cae2131 Jul 28 04:03:45.054247 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: action_args: {'server_id': 'fa036966-7c31-4a36-97fd-4d3eadd09fb0', 'body': {'volumeAttachment': {'volumeId': '558124de-09db-4b0a-8047-6a2c4c25da51'}}} Jul 28 04:03:45.054247 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:03:45.054247 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:45.054247 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 04:03:45.054247 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 04:03:45.054247 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 04:03:45.054247 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 04:03:45.054247 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 04:03:45.054247 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 04:03:45.054247 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 28 04:03:45.054247 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 04:03:45.054247 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 28 04:03:45.054247 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 04:03:45.054247 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 558124de-09db-4b0a-8047-6a2c4c25da51 is already attached to instances: f9103b14-a0f8-40f5-b38b-54b90cae2131 Jul 28 04:03:45.054247 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:03:45.054247 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:03:45.054247 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:03:45.054247 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:45.055594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:03:45.055594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:03:45.055594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:03:45.055594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:03:45.055594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:03:45.055594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:03:45.055594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:03:45.055594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:03:45.055594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:03:45.055594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:03:45.055594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:03:45.055594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:03:45.055594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 04:03:45.055594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 04:03:45.055594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 558124de-09db-4b0a-8047-6a2c4c25da51 is already attached to instances: f9103b14-a0f8-40f5-b38b-54b90cae2131 Jul 28 04:03:45.055594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:03:45.055594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:03:45.055594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:03:45.055594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:45.055594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:03:45.056920 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:03:45.056920 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:03:45.056920 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:03:45.056920 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 558124de-09db-4b0a-8047-6a2c4c25da51 is already attached to instances: f9103b14-a0f8-40f5-b38b-54b90cae2131 Jul 28 04:03:45.056920 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:03:45.058310 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-dd583445-6f0b-4084-9d49-ee8cde7631c9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Returning 400 to user: Invalid volume: volume 558124de-09db-4b0a-8047-6a2c4c25da51 is already attached to instances: f9103b14-a0f8-40f5-b38b-54b90cae2131 {{(pid=118186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:03:45.059422 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-dd583445-6f0b-4084-9d49-ee8cde7631c9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "POST /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.114463 Jul 28 04:03:45.060336 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 244/538] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Jul 28 04:03:44 2022] POST /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0/os-volume_attachments => generated 174 bytes in 116 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 04:03:45.069161 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-dc26e8fd-cd9b-4f53-823e-902f44b0d078 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:45.069668 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-dc26e8fd-cd9b-4f53-823e-902f44b0d078 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:45.076694 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dc26e8fd-cd9b-4f53-823e-902f44b0d078 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:45.077150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dc26e8fd-cd9b-4f53-823e-902f44b0d078 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:45.077920 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dc26e8fd-cd9b-4f53-823e-902f44b0d078 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:45.078530 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dc26e8fd-cd9b-4f53-823e-902f44b0d078 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:45.104444 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-dc26e8fd-cd9b-4f53-823e-902f44b0d078 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Going to try to terminate instance {{(pid=118186) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:03:45.119910 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e7ad1407-5700-48a4-98ed-2cb22d8927b4 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:45.127646 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e7ad1407-5700-48a4-98ed-2cb22d8927b4 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1666 microversion: 2.1 time: 0.166667 Jul 28 04:03:45.128209 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 295/539] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:44 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1666 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:45.196754 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-dc26e8fd-cd9b-4f53-823e-902f44b0d078 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "DELETE /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 204 len: 0 microversion: 2.1 time: 0.131406 Jul 28 04:03:45.197262 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 245/540] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:03:45 2022] DELETE /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:03:45.206155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5f725275-0d06-4183-a448-1f6438d26d2b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:45.206891 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5f725275-0d06-4183-a448-1f6438d26d2b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:45.212864 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f725275-0d06-4183-a448-1f6438d26d2b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:45.213321 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f725275-0d06-4183-a448-1f6438d26d2b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:45.214086 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f725275-0d06-4183-a448-1f6438d26d2b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:45.214528 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f725275-0d06-4183-a448-1f6438d26d2b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:45.349445 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-efb0f073-9e97-4c73-9ea1-b054c50db4d5 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:45.349911 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5f725275-0d06-4183-a448-1f6438d26d2b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:45.350383 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-efb0f073-9e97-4c73-9ea1-b054c50db4d5 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] [instance: 0982f3c1-3389-457d-bd4b-eec27d51a58d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:45.356593 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-efb0f073-9e97-4c73-9ea1-b054c50db4d5 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:45.357044 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-efb0f073-9e97-4c73-9ea1-b054c50db4d5 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:45.357407 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5f725275-0d06-4183-a448-1f6438d26d2b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 200 len: 1682 microversion: 2.1 time: 0.155600 Jul 28 04:03:45.357810 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-efb0f073-9e97-4c73-9ea1-b054c50db4d5 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:45.358279 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 296/541] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:45 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:45.358405 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-efb0f073-9e97-4c73-9ea1-b054c50db4d5 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:45.409976 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b3379884-a01d-4cbd-b64f-1f61fbda9ef3 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:45.410604 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b3379884-a01d-4cbd-b64f-1f61fbda9ef3 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:45.417030 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b3379884-a01d-4cbd-b64f-1f61fbda9ef3 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:45.417492 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b3379884-a01d-4cbd-b64f-1f61fbda9ef3 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:45.418263 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b3379884-a01d-4cbd-b64f-1f61fbda9ef3 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:45.418711 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b3379884-a01d-4cbd-b64f-1f61fbda9ef3 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:45.493121 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-efb0f073-9e97-4c73-9ea1-b054c50db4d5 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ba6235b4fd4730a64345f87853c781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e529b4a644299a617363fe78049eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:45.500427 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-efb0f073-9e97-4c73-9ea1-b054c50db4d5 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] 10.222.0.46 "GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d" status: 200 len: 1314 microversion: 2.1 time: 0.156706 Jul 28 04:03:45.500996 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 246/542] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:45 2022] GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:45.555234 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b3379884-a01d-4cbd-b64f-1f61fbda9ef3 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:45.563025 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b3379884-a01d-4cbd-b64f-1f61fbda9ef3 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 200 len: 1264 microversion: 2.1 time: 0.157574 Jul 28 04:03:45.563661 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 297/543] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:45 2022] GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:46.378908 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-9dad411c-4b54-413b-b053-061fb5cdfd3f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:46.379531 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-9dad411c-4b54-413b-b053-061fb5cdfd3f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:46.381938 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell0:SELECT=4 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:46.388366 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9dad411c-4b54-413b-b053-061fb5cdfd3f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:46.388856 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9dad411c-4b54-413b-b053-061fb5cdfd3f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:46.389635 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9dad411c-4b54-413b-b053-061fb5cdfd3f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:46.390201 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9dad411c-4b54-413b-b053-061fb5cdfd3f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:46.410024 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:46.521980 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f329f5f1-ff5d-491f-880b-d253644e43fd tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:46.522616 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f329f5f1-ff5d-491f-880b-d253644e43fd tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] [instance: 0982f3c1-3389-457d-bd4b-eec27d51a58d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:46.524680 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=4 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:46.525453 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=12 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:46.526684 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=6 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:46.527011 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-9dad411c-4b54-413b-b053-061fb5cdfd3f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:46.533396 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f329f5f1-ff5d-491f-880b-d253644e43fd tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:46.533862 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f329f5f1-ff5d-491f-880b-d253644e43fd tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:46.534841 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f329f5f1-ff5d-491f-880b-d253644e43fd tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:46.535274 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f329f5f1-ff5d-491f-880b-d253644e43fd tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:46.535499 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-9dad411c-4b54-413b-b053-061fb5cdfd3f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 200 len: 1682 microversion: 2.1 time: 0.160454 Jul 28 04:03:46.536306 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 247/544] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:46 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 1682 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:46.583187 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c0fff2e0-b20e-4c9a-8ec0-8b06a0733509 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:46.583808 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c0fff2e0-b20e-4c9a-8ec0-8b06a0733509 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:46.590905 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c0fff2e0-b20e-4c9a-8ec0-8b06a0733509 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:46.591639 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c0fff2e0-b20e-4c9a-8ec0-8b06a0733509 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:46.592918 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c0fff2e0-b20e-4c9a-8ec0-8b06a0733509 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:46.593643 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c0fff2e0-b20e-4c9a-8ec0-8b06a0733509 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:46.677683 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f329f5f1-ff5d-491f-880b-d253644e43fd tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ba6235b4fd4730a64345f87853c781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e529b4a644299a617363fe78049eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:46.685354 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f329f5f1-ff5d-491f-880b-d253644e43fd tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] 10.222.0.46 "GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d" status: 200 len: 1464 microversion: 2.1 time: 0.167781 Jul 28 04:03:46.686126 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 298/545] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:46 2022] GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d => generated 1464 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:46.728067 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-c0fff2e0-b20e-4c9a-8ec0-8b06a0733509 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:46.731063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-247468e6-575c-4cd1-8107-943cf937b8f0 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:46.731573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-247468e6-575c-4cd1-8107-943cf937b8f0 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] [instance: 0982f3c1-3389-457d-bd4b-eec27d51a58d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:46.735620 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-c0fff2e0-b20e-4c9a-8ec0-8b06a0733509 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 200 len: 1264 microversion: 2.1 time: 0.156394 Jul 28 04:03:46.736366 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 248/546] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:46 2022] GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:46.738678 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-247468e6-575c-4cd1-8107-943cf937b8f0 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:46.739163 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-247468e6-575c-4cd1-8107-943cf937b8f0 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:46.739945 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-247468e6-575c-4cd1-8107-943cf937b8f0 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:46.740387 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-247468e6-575c-4cd1-8107-943cf937b8f0 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:46.766402 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-247468e6-575c-4cd1-8107-943cf937b8f0 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] [instance: 0982f3c1-3389-457d-bd4b-eec27d51a58d] Going to try to terminate instance {{(pid=118187) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:03:46.837874 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-247468e6-575c-4cd1-8107-943cf937b8f0 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] 10.222.0.46 "DELETE /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d" status: 204 len: 0 microversion: 2.1 time: 0.110521 Jul 28 04:03:46.838450 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 299/547] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:03:46 2022] DELETE /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:03:46.847616 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-f4ab100b-3ba9-40bb-a247-1a6f1967b424 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:46.848150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-f4ab100b-3ba9-40bb-a247-1a6f1967b424 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] [instance: 0982f3c1-3389-457d-bd4b-eec27d51a58d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:46.854101 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f4ab100b-3ba9-40bb-a247-1a6f1967b424 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:46.854555 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f4ab100b-3ba9-40bb-a247-1a6f1967b424 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:46.855351 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f4ab100b-3ba9-40bb-a247-1a6f1967b424 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:46.855790 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f4ab100b-3ba9-40bb-a247-1a6f1967b424 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:46.991475 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-f4ab100b-3ba9-40bb-a247-1a6f1967b424 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ba6235b4fd4730a64345f87853c781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e529b4a644299a617363fe78049eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:46.998915 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-f4ab100b-3ba9-40bb-a247-1a6f1967b424 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] 10.222.0.46 "GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d" status: 200 len: 1470 microversion: 2.1 time: 0.155948 Jul 28 04:03:46.999489 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 249/548] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:46 2022] GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d => generated 1470 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:47.560137 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d70dea7a-0714-427f-bb41-10a3a526ef70 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:47.560830 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d70dea7a-0714-427f-bb41-10a3a526ef70 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:47.567938 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d70dea7a-0714-427f-bb41-10a3a526ef70 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:47.568605 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d70dea7a-0714-427f-bb41-10a3a526ef70 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:47.569368 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d70dea7a-0714-427f-bb41-10a3a526ef70 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:47.569798 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d70dea7a-0714-427f-bb41-10a3a526ef70 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:47.588849 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:47.706665 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d70dea7a-0714-427f-bb41-10a3a526ef70 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:47.714088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d70dea7a-0714-427f-bb41-10a3a526ef70 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 200 len: 1682 microversion: 2.1 time: 0.158170 Jul 28 04:03:47.714647 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 300/549] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:47 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:47.756784 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-29c4ab9f-747d-4630-8b3b-ce38f36987dc tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:47.757476 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-29c4ab9f-747d-4630-8b3b-ce38f36987dc tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:47.765156 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-29c4ab9f-747d-4630-8b3b-ce38f36987dc tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:47.765613 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-29c4ab9f-747d-4630-8b3b-ce38f36987dc tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:47.766392 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-29c4ab9f-747d-4630-8b3b-ce38f36987dc tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:47.766861 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-29c4ab9f-747d-4630-8b3b-ce38f36987dc tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:47.897222 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-29c4ab9f-747d-4630-8b3b-ce38f36987dc tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:47.910869 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-29c4ab9f-747d-4630-8b3b-ce38f36987dc tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 200 len: 1264 microversion: 2.1 time: 0.158637 Jul 28 04:03:47.911451 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 250/550] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:47 2022] GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:48.021582 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d703c9a1-6118-4ccb-8773-d1059fab064f tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:48.022203 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d703c9a1-6118-4ccb-8773-d1059fab064f tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] [instance: 0982f3c1-3389-457d-bd4b-eec27d51a58d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:48.028609 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d703c9a1-6118-4ccb-8773-d1059fab064f tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:48.029075 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d703c9a1-6118-4ccb-8773-d1059fab064f tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:48.029848 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d703c9a1-6118-4ccb-8773-d1059fab064f tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:48.030292 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d703c9a1-6118-4ccb-8773-d1059fab064f tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:48.157385 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d703c9a1-6118-4ccb-8773-d1059fab064f tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ba6235b4fd4730a64345f87853c781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e529b4a644299a617363fe78049eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:48.165041 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d703c9a1-6118-4ccb-8773-d1059fab064f tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] 10.222.0.46 "GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d" status: 200 len: 1470 microversion: 2.1 time: 0.147601 Jul 28 04:03:48.165630 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 301/551] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:48 2022] GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d => generated 1470 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:48.734924 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-2caf5a41-2e83-4885-a3b6-aa65472c7e10 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:48.735552 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-2caf5a41-2e83-4885-a3b6-aa65472c7e10 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:48.741645 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2caf5a41-2e83-4885-a3b6-aa65472c7e10 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:48.742133 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2caf5a41-2e83-4885-a3b6-aa65472c7e10 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:48.742929 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2caf5a41-2e83-4885-a3b6-aa65472c7e10 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:48.743367 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2caf5a41-2e83-4885-a3b6-aa65472c7e10 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:48.870560 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-2caf5a41-2e83-4885-a3b6-aa65472c7e10 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:48.878141 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-2caf5a41-2e83-4885-a3b6-aa65472c7e10 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 200 len: 1682 microversion: 2.1 time: 0.147123 Jul 28 04:03:48.878707 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 251/552] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:48 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 1682 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:48.931338 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-10e1c98f-d956-4156-aeea-9651feed24c7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:48.931881 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-10e1c98f-d956-4156-aeea-9651feed24c7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:48.938273 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-10e1c98f-d956-4156-aeea-9651feed24c7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:48.938716 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-10e1c98f-d956-4156-aeea-9651feed24c7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:48.939512 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-10e1c98f-d956-4156-aeea-9651feed24c7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:48.939944 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-10e1c98f-d956-4156-aeea-9651feed24c7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:49.072515 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-10e1c98f-d956-4156-aeea-9651feed24c7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:49.080009 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-10e1c98f-d956-4156-aeea-9651feed24c7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 200 len: 1264 microversion: 2.1 time: 0.152476 Jul 28 04:03:49.081355 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 302/553] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:48 2022] GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:49.187056 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-b8a54d8d-848d-4430-a84f-0f7053dc8919 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:49.187607 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-b8a54d8d-848d-4430-a84f-0f7053dc8919 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] [instance: 0982f3c1-3389-457d-bd4b-eec27d51a58d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:49.194092 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b8a54d8d-848d-4430-a84f-0f7053dc8919 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:49.194540 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b8a54d8d-848d-4430-a84f-0f7053dc8919 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:49.195338 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b8a54d8d-848d-4430-a84f-0f7053dc8919 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:49.195766 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b8a54d8d-848d-4430-a84f-0f7053dc8919 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:49.323889 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-b8a54d8d-848d-4430-a84f-0f7053dc8919 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ba6235b4fd4730a64345f87853c781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e529b4a644299a617363fe78049eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:49.332094 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-b8a54d8d-848d-4430-a84f-0f7053dc8919 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] 10.222.0.46 "GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d" status: 200 len: 1470 microversion: 2.1 time: 0.148969 Jul 28 04:03:49.332649 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 252/554] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:49 2022] GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d => generated 1470 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:49.900276 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6f7fc900-c8dd-400b-9d91-d7e31ad93089 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:49.900900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6f7fc900-c8dd-400b-9d91-d7e31ad93089 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:49.907270 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6f7fc900-c8dd-400b-9d91-d7e31ad93089 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:49.907718 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6f7fc900-c8dd-400b-9d91-d7e31ad93089 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:49.908570 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6f7fc900-c8dd-400b-9d91-d7e31ad93089 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:49.909028 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6f7fc900-c8dd-400b-9d91-d7e31ad93089 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:50.044678 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6f7fc900-c8dd-400b-9d91-d7e31ad93089 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:50.052737 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6f7fc900-c8dd-400b-9d91-d7e31ad93089 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 200 len: 1682 microversion: 2.1 time: 0.157089 Jul 28 04:03:50.053316 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 303/555] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:49 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:50.101163 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-e1a7aa1d-0da1-4194-8075-46c5caeb0c57 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:50.101862 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-e1a7aa1d-0da1-4194-8075-46c5caeb0c57 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:50.108423 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e1a7aa1d-0da1-4194-8075-46c5caeb0c57 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:50.108936 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e1a7aa1d-0da1-4194-8075-46c5caeb0c57 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:50.109760 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e1a7aa1d-0da1-4194-8075-46c5caeb0c57 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:50.110255 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e1a7aa1d-0da1-4194-8075-46c5caeb0c57 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:50.353326 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f71153ff-1a45-4daa-89a1-124b1eb3b105 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:50.353954 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f71153ff-1a45-4daa-89a1-124b1eb3b105 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] [instance: 0982f3c1-3389-457d-bd4b-eec27d51a58d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:50.361039 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f71153ff-1a45-4daa-89a1-124b1eb3b105 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:50.362717 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f71153ff-1a45-4daa-89a1-124b1eb3b105 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:50.363541 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f71153ff-1a45-4daa-89a1-124b1eb3b105 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:50.363988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f71153ff-1a45-4daa-89a1-124b1eb3b105 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:50.504121 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f71153ff-1a45-4daa-89a1-124b1eb3b105 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ba6235b4fd4730a64345f87853c781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e529b4a644299a617363fe78049eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:50.511541 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f71153ff-1a45-4daa-89a1-124b1eb3b105 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] 10.222.0.46 "GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d" status: 200 len: 1470 microversion: 2.1 time: 0.162310 Jul 28 04:03:50.512107 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 304/556] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:50 2022] GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d => generated 1470 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:50.555935 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-e1a7aa1d-0da1-4194-8075-46c5caeb0c57 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:50.566063 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-e1a7aa1d-0da1-4194-8075-46c5caeb0c57 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 200 len: 1264 microversion: 2.1 time: 0.468693 Jul 28 04:03:50.566709 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 253/557] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:50 2022] GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 1264 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:51.025922 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-ef43c412-f0da-4bf1-ab79-46ba045202ca req-fd28c182-e211-4238-8e0d-561b9bfb7e51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0982f3c1-3389-457d-bd4b-eec27d51a58d", "name": "network-vif-deleted", "tag": "65f322e7-3a40-40ac-8264-2e03dc6493c6"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:51.042651 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-ef43c412-f0da-4bf1-ab79-46ba045202ca req-fd28c182-e211-4238-8e0d-561b9bfb7e51 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:51.043495 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-ef43c412-f0da-4bf1-ab79-46ba045202ca req-fd28c182-e211-4238-8e0d-561b9bfb7e51 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:51.062358 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-ef43c412-f0da-4bf1-ab79-46ba045202ca req-fd28c182-e211-4238-8e0d-561b9bfb7e51 service nova] Creating event network-vif-deleted:65f322e7-3a40-40ac-8264-2e03dc6493c6 for instance 0982f3c1-3389-457d-bd4b-eec27d51a58d on hv-cinder-79987 Jul 28 04:03:51.071643 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-ef43c412-f0da-4bf1-ab79-46ba045202ca req-fd28c182-e211-4238-8e0d-561b9bfb7e51 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049745 Jul 28 04:03:51.072817 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 305/558] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:51.073778 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-d0a46830-0536-496c-a6b9-78a4c6e46f77 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:51.074424 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-d0a46830-0536-496c-a6b9-78a4c6e46f77 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:51.082753 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d0a46830-0536-496c-a6b9-78a4c6e46f77 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:51.085130 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d0a46830-0536-496c-a6b9-78a4c6e46f77 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:51.085926 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d0a46830-0536-496c-a6b9-78a4c6e46f77 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:51.086363 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d0a46830-0536-496c-a6b9-78a4c6e46f77 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:51.463287 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-d0a46830-0536-496c-a6b9-78a4c6e46f77 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:51.472905 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-d0a46830-0536-496c-a6b9-78a4c6e46f77 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 200 len: 1615 microversion: 2.1 time: 0.403004 Jul 28 04:03:51.486821 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 254/559] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:51 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 1615 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:51.539790 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c44fad5c-838f-4934-900b-d51c32ef5bcb tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:51.541424 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c44fad5c-838f-4934-900b-d51c32ef5bcb tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] [instance: 0982f3c1-3389-457d-bd4b-eec27d51a58d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:51.550384 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c44fad5c-838f-4934-900b-d51c32ef5bcb tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:51.551259 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c44fad5c-838f-4934-900b-d51c32ef5bcb tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:51.552356 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c44fad5c-838f-4934-900b-d51c32ef5bcb tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:51.553670 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c44fad5c-838f-4934-900b-d51c32ef5bcb tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:51.586140 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-b231840d-184f-49fd-8bc4-d257b3d31600 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:51.586919 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-b231840d-184f-49fd-8bc4-d257b3d31600 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:51.599270 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b231840d-184f-49fd-8bc4-d257b3d31600 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:51.600081 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b231840d-184f-49fd-8bc4-d257b3d31600 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:51.600915 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b231840d-184f-49fd-8bc4-d257b3d31600 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:51.601341 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c44fad5c-838f-4934-900b-d51c32ef5bcb tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:51.601465 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b231840d-184f-49fd-8bc4-d257b3d31600 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:51.601801 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c44fad5c-838f-4934-900b-d51c32ef5bcb tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:51.602256 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.objects.instance [None req-c44fad5c-838f-4934-900b-d51c32ef5bcb tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lazy-loading 'fault' on Instance uuid 0982f3c1-3389-457d-bd4b-eec27d51a58d {{(pid=118187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:03:51.672792 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c44fad5c-838f-4934-900b-d51c32ef5bcb tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '78ba6235b4fd4730a64345f87853c781', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c1e529b4a644299a617363fe78049eb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:51.682955 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c44fad5c-838f-4934-900b-d51c32ef5bcb tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] 10.222.0.46 "GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d" status: 200 len: 1304 microversion: 2.1 time: 0.152427 Jul 28 04:03:51.683541 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 306/560] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:51 2022] GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d => generated 1304 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:51.790511 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-b231840d-184f-49fd-8bc4-d257b3d31600 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:51.799928 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-b231840d-184f-49fd-8bc4-d257b3d31600 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 200 len: 1264 microversion: 2.1 time: 0.217517 Jul 28 04:03:51.800722 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 255/561] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:51 2022] GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 1264 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:03:52.494507 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b44966d4-0a0c-448f-bf00-4d21f5ebdad4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:52.495290 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b44966d4-0a0c-448f-bf00-4d21f5ebdad4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:52.503398 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b44966d4-0a0c-448f-bf00-4d21f5ebdad4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:52.503862 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b44966d4-0a0c-448f-bf00-4d21f5ebdad4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:52.504683 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b44966d4-0a0c-448f-bf00-4d21f5ebdad4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:52.505125 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b44966d4-0a0c-448f-bf00-4d21f5ebdad4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:52.519351 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-b44966d4-0a0c-448f-bf00-4d21f5ebdad4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] HTTP exception thrown: Instance fa036966-7c31-4a36-97fd-4d3eadd09fb0 could not be found. Jul 28 04:03:52.521020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b44966d4-0a0c-448f-bf00-4d21f5ebdad4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Request method failure captured: Jul 28 04:03:52.521020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 HTTP/1.1 Jul 28 04:03:52.521020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:03:52.521020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:03:52.521020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:03:52.521020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:03:52.521020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:03:52.521020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:03:52.521020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:03:52.521020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:03:52.521020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gmoXQtNoyNZeVOBtHeH0p0IZl6gLmXu7uMplYaqMcIU3TXk6NAztCb7-3xvXPbqffriel8JQiqKAHgD2FYfvE1RoXCiUMTvpIZjixGVtBiBXhQr6lOIK0tmH4bMvCgHENHbbkhJpWpz1XJYt5CJBH3JqJi5ypO8pp_YsE0VFSnKOUI Jul 28 04:03:52.521020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:03:52.521020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:03:52.521020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:03:52.521020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:03:52.521020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:03:52.521020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:03:52.521020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:03:52.521020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:03:52.521020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:03:52.521020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:03:52.522356 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_18a927e9f5da42d7b34752c8b2db211a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/18a927e9f5da42d7b34752c8b2db211a"}]}] Jul 28 04:03:52.522356 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:03:52.522356 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:03:52.522356 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:03:52.522356 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:03:52.522356 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:03:52.522356 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:03:52.522356 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: c3308761e9d2495e95e127bbc7b9c5e2 Jul 28 04:03:52.522356 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:03:52.522356 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:03:52.522356 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Instance fa036966-7c31-4a36-97fd-4d3eadd09fb0 could not be found. Jul 28 04:03:52.522356 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': 'fa036966-7c31-4a36-97fd-4d3eadd09fb0'} Jul 28 04:03:52.523437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:03:52.523437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:52.523437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:03:52.523437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:03:52.523437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:03:52.523437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:03:52.523437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:03:52.523437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:03:52.523437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:03:52.523437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:03:52.523437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa036966-7c31-4a36-97fd-4d3eadd09fb0 could not be found. Jul 28 04:03:52.523437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:03:52.523437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:03:52.523437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:03:52.523437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:52.523437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:03:52.523437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:03:52.523437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:03:52.523437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:03:52.523437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:03:52.525043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:03:52.525043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:03:52.525043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:03:52.525043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:03:52.525043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:03:52.525043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:03:52.525043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:03:52.525043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa036966-7c31-4a36-97fd-4d3eadd09fb0 could not be found. Jul 28 04:03:52.525043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:03:52.525043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:03:52.525043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:03:52.525043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:52.525043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:03:52.525043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:03:52.525043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:03:52.525043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:03:52.525043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa036966-7c31-4a36-97fd-4d3eadd09fb0 could not be found. Jul 28 04:03:52.525043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:03:52.526493 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b44966d4-0a0c-448f-bf00-4d21f5ebdad4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Returning 404 to user: Instance fa036966-7c31-4a36-97fd-4d3eadd09fb0 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:03:52.526493 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b44966d4-0a0c-448f-bf00-4d21f5ebdad4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 404 len: 111 microversion: 2.1 time: 0.032532 Jul 28 04:03:52.526493 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 307/562] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:52 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:03:52.531633 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-8571c13e-ef01-4595-b4d5-cafb0cabb222 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '.version_select at 0x7fa6ee0b3f70>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:52.540259 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=90,nova_api:UPDATE=1 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:52.564085 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-8571c13e-ef01-4595-b4d5-cafb0cabb222 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1140484560" status: 202 len: 0 microversion: 2.1 time: 0.036135 Jul 28 04:03:52.565767 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 256/563] 10.222.0.46 () {58 vars in 1221 bytes} [Thu Jul 28 04:03:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1140484560 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:03:52.711548 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7fd33f41-24da-455a-a2a4-052eb4db33d3 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:52.712601 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7fd33f41-24da-455a-a2a4-052eb4db33d3 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] [instance: 0982f3c1-3389-457d-bd4b-eec27d51a58d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:52.731857 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7fd33f41-24da-455a-a2a4-052eb4db33d3 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:52.732204 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7fd33f41-24da-455a-a2a4-052eb4db33d3 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:52.732996 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7fd33f41-24da-455a-a2a4-052eb4db33d3 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:52.733445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7fd33f41-24da-455a-a2a4-052eb4db33d3 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:52.766862 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-7fd33f41-24da-455a-a2a4-052eb4db33d3 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] HTTP exception thrown: Instance 0982f3c1-3389-457d-bd4b-eec27d51a58d could not be found. Jul 28 04:03:52.769904 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7fd33f41-24da-455a-a2a4-052eb4db33d3 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Request method failure captured: Jul 28 04:03:52.769904 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d HTTP/1.1 Jul 28 04:03:52.769904 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:03:52.769904 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:03:52.769904 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:03:52.769904 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:03:52.769904 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:03:52.769904 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:03:52.769904 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:03:52.769904 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:03:52.769904 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gqQc1xADOhuIEhYC4KrYTlopHh8IsOQ0naBP94UOvts-WpQ8hPVcFahDenIUfbkldv1HsyBTmMrepNR5_iR1CgtPWfhEuvIM3GUgzkZiJ8Q98NlaTfAh70K8-XA3-4w4x1VhwWDYPVvZcu_o7lbwPp57xVyT015j9N0F6wscOQf_64 Jul 28 04:03:52.769904 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:03:52.769904 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:03:52.769904 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:03:52.769904 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:03:52.769904 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:03:52.769904 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:03:52.769904 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 9c1e529b4a644299a617363fe78049eb Jul 28 04:03:52.769904 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-VolumesNegativeTest-1331291343 Jul 28 04:03:52.769904 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:03:52.769904 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:03:52.771320 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_9c1e529b4a644299a617363fe78049eb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c1e529b4a644299a617363fe78049eb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/9c1e529b4a644299a617363fe78049eb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/9c1e529b4a644299a617363fe78049eb"}]}] Jul 28 04:03:52.771320 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-VolumesNegativeTest-1331291343 Jul 28 04:03:52.771320 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 9c1e529b4a644299a617363fe78049eb Jul 28 04:03:52.771320 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-VolumesNegativeTest-1331291343 Jul 28 04:03:52.771320 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-VolumesNegativeTest-1331291343-project Jul 28 04:03:52.771320 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:03:52.771320 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:03:52.771320 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: 78ba6235b4fd4730a64345f87853c781 Jul 28 04:03:52.771320 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-VolumesNegativeTest-1331291343-project Jul 28 04:03:52.771320 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:03:52.771320 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Instance 0982f3c1-3389-457d-bd4b-eec27d51a58d could not be found. Jul 28 04:03:52.771320 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': '0982f3c1-3389-457d-bd4b-eec27d51a58d'} Jul 28 04:03:52.772143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:03:52.772143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:52.772143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:03:52.772143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:03:52.772143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:03:52.772143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:03:52.772143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:03:52.772143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:03:52.772143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:03:52.772143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:03:52.772143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0982f3c1-3389-457d-bd4b-eec27d51a58d could not be found. Jul 28 04:03:52.772143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:03:52.772143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:03:52.772143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:03:52.772143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:52.772143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:03:52.772143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:03:52.772143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:03:52.772143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:03:52.772143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:03:52.773306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:03:52.773306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:03:52.773306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:03:52.773306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:03:52.773306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:03:52.773306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:03:52.773306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:03:52.773306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0982f3c1-3389-457d-bd4b-eec27d51a58d could not be found. Jul 28 04:03:52.773306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:03:52.773306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:03:52.773306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:03:52.773306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:52.773306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:03:52.773306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:03:52.773306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:03:52.773306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:03:52.773306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0982f3c1-3389-457d-bd4b-eec27d51a58d could not be found. Jul 28 04:03:52.773306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:03:52.776805 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7fd33f41-24da-455a-a2a4-052eb4db33d3 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] Returning 404 to user: Instance 0982f3c1-3389-457d-bd4b-eec27d51a58d could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:03:52.778026 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7fd33f41-24da-455a-a2a4-052eb4db33d3 tempest-VolumesNegativeTest-1331291343 tempest-VolumesNegativeTest-1331291343-project] 10.222.0.46 "GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d" status: 404 len: 111 microversion: 2.1 time: 0.072172 Jul 28 04:03:52.779392 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 308/564] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:52 2022] GET /compute/v2.1/servers/0982f3c1-3389-457d-bd4b-eec27d51a58d => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:03:52.822550 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-2c8456f7-67c4-4349-aa68-e45d9bb4a970 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:52.823397 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-2c8456f7-67c4-4349-aa68-e45d9bb4a970 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:52.838405 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2c8456f7-67c4-4349-aa68-e45d9bb4a970 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:52.840163 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2c8456f7-67c4-4349-aa68-e45d9bb4a970 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:52.842686 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2c8456f7-67c4-4349-aa68-e45d9bb4a970 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:52.843900 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2c8456f7-67c4-4349-aa68-e45d9bb4a970 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:53.199718 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-186ef124-6f1f-4ab8-980a-585c5ae77dbe req-0edb4270-bfef-4681-afcb-125dd3b40e49 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa036966-7c31-4a36-97fd-4d3eadd09fb0", "name": "network-vif-deleted", "tag": "df6e2763-2336-4f96-9cf5-6bda9111085f"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:53.220414 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-186ef124-6f1f-4ab8-980a-585c5ae77dbe req-0edb4270-bfef-4681-afcb-125dd3b40e49 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:53.221127 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-186ef124-6f1f-4ab8-980a-585c5ae77dbe req-0edb4270-bfef-4681-afcb-125dd3b40e49 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:53.252901 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-186ef124-6f1f-4ab8-980a-585c5ae77dbe req-0edb4270-bfef-4681-afcb-125dd3b40e49 service nova] Creating event network-vif-deleted:df6e2763-2336-4f96-9cf5-6bda9111085f for instance fa036966-7c31-4a36-97fd-4d3eadd09fb0 on hv-cinder-79987 Jul 28 04:03:53.266080 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-186ef124-6f1f-4ab8-980a-585c5ae77dbe req-0edb4270-bfef-4681-afcb-125dd3b40e49 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069649 Jul 28 04:03:53.266978 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 309/565] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:53.291608 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-2c8456f7-67c4-4349-aa68-e45d9bb4a970 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:53.315182 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-2c8456f7-67c4-4349-aa68-e45d9bb4a970 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 200 len: 1264 microversion: 2.1 time: 0.496618 Jul 28 04:03:53.315734 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 257/566] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:52 2022] GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 1264 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:53.383602 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-f20e8cce-9f77-4176-9980-e8f414a8a8c2 req-cc98f6de-0d90-48ad-9ac5-bd0e4a17d5e9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b73f1a1-e07f-4ebe-af69-e188924a9073", "name": "network-vif-plugged", "status": "completed", "tag": "8f78dd8c-353e-4f87-bef6-e8bc130d65a0"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:53.397558 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-f20e8cce-9f77-4176-9980-e8f414a8a8c2 req-cc98f6de-0d90-48ad-9ac5-bd0e4a17d5e9 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:53.398460 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-f20e8cce-9f77-4176-9980-e8f414a8a8c2 req-cc98f6de-0d90-48ad-9ac5-bd0e4a17d5e9 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:53.417440 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-f20e8cce-9f77-4176-9980-e8f414a8a8c2 req-cc98f6de-0d90-48ad-9ac5-bd0e4a17d5e9 service nova] Creating event network-vif-plugged:8f78dd8c-353e-4f87-bef6-e8bc130d65a0 for instance 5b73f1a1-e07f-4ebe-af69-e188924a9073 on hv-cinder-79987 Jul 28 04:03:53.424815 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-f20e8cce-9f77-4176-9980-e8f414a8a8c2 req-cc98f6de-0d90-48ad-9ac5-bd0e4a17d5e9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047010 Jul 28 04:03:53.426460 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 310/567] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:03:53.871295 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-b54154ed-30bb-41f9-ac69-f351c4b1cdb0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:53.872416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-b54154ed-30bb-41f9-ac69-f351c4b1cdb0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:53.880963 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b54154ed-30bb-41f9-ac69-f351c4b1cdb0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:53.881410 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b54154ed-30bb-41f9-ac69-f351c4b1cdb0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:53.882194 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b54154ed-30bb-41f9-ac69-f351c4b1cdb0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:53.882628 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b54154ed-30bb-41f9-ac69-f351c4b1cdb0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:53.969458 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.objects.instance [None req-b54154ed-30bb-41f9-ac69-f351c4b1cdb0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lazy-loading 'services' on Instance uuid f9103b14-a0f8-40f5-b38b-54b90cae2131 {{(pid=118186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:03:54.042370 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-b54154ed-30bb-41f9-ac69-f351c4b1cdb0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131/os-volume_attachments/558124de-09db-4b0a-8047-6a2c4c25da51" status: 202 len: 0 microversion: 2.1 time: 0.178649 Jul 28 04:03:54.042885 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 258/568] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Jul 28 04:03:53 2022] DELETE /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131/os-volume_attachments/558124de-09db-4b0a-8047-6a2c4c25da51 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:03:54.052959 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-49774859-c0e4-4e2c-a8c6-0f931aae31ee tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:54.055390 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-49774859-c0e4-4e2c-a8c6-0f931aae31ee tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:54.062531 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-49774859-c0e4-4e2c-a8c6-0f931aae31ee tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:54.063173 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-49774859-c0e4-4e2c-a8c6-0f931aae31ee tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:54.063953 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-49774859-c0e4-4e2c-a8c6-0f931aae31ee tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:54.064672 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-49774859-c0e4-4e2c-a8c6-0f931aae31ee tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:54.098276 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-49774859-c0e4-4e2c-a8c6-0f931aae31ee tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050551 Jul 28 04:03:54.099142 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 311/569] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Jul 28 04:03:54 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:54.336877 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-99393109-8165-4ebc-ba5c-d8b1cecdd157 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:54.337586 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-99393109-8165-4ebc-ba5c-d8b1cecdd157 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:54.344503 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-99393109-8165-4ebc-ba5c-d8b1cecdd157 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:54.345038 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-99393109-8165-4ebc-ba5c-d8b1cecdd157 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:54.346044 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-99393109-8165-4ebc-ba5c-d8b1cecdd157 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:54.346550 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-99393109-8165-4ebc-ba5c-d8b1cecdd157 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:54.488869 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-99393109-8165-4ebc-ba5c-d8b1cecdd157 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:54.496377 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-99393109-8165-4ebc-ba5c-d8b1cecdd157 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 200 len: 1264 microversion: 2.1 time: 0.163755 Jul 28 04:03:54.496939 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 259/570] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:54 2022] GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:55.110709 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-de7a124e-dc73-40f2-bc57-406e9ee7cc5d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:55.113673 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-de7a124e-dc73-40f2-bc57-406e9ee7cc5d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:55.121375 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-de7a124e-dc73-40f2-bc57-406e9ee7cc5d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:55.122018 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-de7a124e-dc73-40f2-bc57-406e9ee7cc5d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:55.123063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-de7a124e-dc73-40f2-bc57-406e9ee7cc5d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:55.123564 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-de7a124e-dc73-40f2-bc57-406e9ee7cc5d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:55.157085 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-de7a124e-dc73-40f2-bc57-406e9ee7cc5d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050230 Jul 28 04:03:55.157661 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 312/571] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Jul 28 04:03:55 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:55.517144 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-7ab1e420-013f-4b24-9a04-a13df1c75ee3 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:55.518340 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-7ab1e420-013f-4b24-9a04-a13df1c75ee3 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:55.525193 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7ab1e420-013f-4b24-9a04-a13df1c75ee3 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:55.525635 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7ab1e420-013f-4b24-9a04-a13df1c75ee3 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:55.526426 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7ab1e420-013f-4b24-9a04-a13df1c75ee3 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:55.526911 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7ab1e420-013f-4b24-9a04-a13df1c75ee3 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:55.693126 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-7ab1e420-013f-4b24-9a04-a13df1c75ee3 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:55.701704 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-7ab1e420-013f-4b24-9a04-a13df1c75ee3 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 200 len: 1264 microversion: 2.1 time: 0.188032 Jul 28 04:03:55.702309 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 260/572] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:55 2022] GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 1264 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:56.170049 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-40e68078-a2cc-4596-88ee-bab5f9ce56d9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:56.172825 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-40e68078-a2cc-4596-88ee-bab5f9ce56d9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:56.180388 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-40e68078-a2cc-4596-88ee-bab5f9ce56d9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:56.180843 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-40e68078-a2cc-4596-88ee-bab5f9ce56d9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:56.181648 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-40e68078-a2cc-4596-88ee-bab5f9ce56d9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:56.182081 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-40e68078-a2cc-4596-88ee-bab5f9ce56d9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:56.212621 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-40e68078-a2cc-4596-88ee-bab5f9ce56d9 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046992 Jul 28 04:03:56.213106 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 313/573] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Jul 28 04:03:56 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:03:56.275465 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-4802ca03-1c65-436a-a135-c40d03aa75cf tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:56.275964 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-4802ca03-1c65-436a-a135-c40d03aa75cf tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:56.281900 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4802ca03-1c65-436a-a135-c40d03aa75cf tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:56.282357 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4802ca03-1c65-436a-a135-c40d03aa75cf tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:56.283760 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4802ca03-1c65-436a-a135-c40d03aa75cf tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:56.284200 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4802ca03-1c65-436a-a135-c40d03aa75cf tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:56.308494 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-4802ca03-1c65-436a-a135-c40d03aa75cf tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Going to try to terminate instance {{(pid=118186) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:03:56.384493 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-4802ca03-1c65-436a-a135-c40d03aa75cf tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 204 len: 0 microversion: 2.1 time: 0.112431 Jul 28 04:03:56.385229 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 261/574] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:03:56 2022] DELETE /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:03:56.394358 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-eb6aafb1-dc93-4689-988a-85ce176bafbf tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:56.395047 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-eb6aafb1-dc93-4689-988a-85ce176bafbf tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:56.401121 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-eb6aafb1-dc93-4689-988a-85ce176bafbf tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:56.401577 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-eb6aafb1-dc93-4689-988a-85ce176bafbf tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:56.402342 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-eb6aafb1-dc93-4689-988a-85ce176bafbf tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:56.402825 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-eb6aafb1-dc93-4689-988a-85ce176bafbf tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:56.531176 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-eb6aafb1-dc93-4689-988a-85ce176bafbf tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:56.539187 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-eb6aafb1-dc93-4689-988a-85ce176bafbf tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1681 microversion: 2.1 time: 0.149382 Jul 28 04:03:56.539765 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 314/575] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:56 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:56.723398 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-8b887e97-31c2-4c05-9f58-2818547d2ac0 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:56.724133 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-8b887e97-31c2-4c05-9f58-2818547d2ac0 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:56.731023 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8b887e97-31c2-4c05-9f58-2818547d2ac0 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:56.731422 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8b887e97-31c2-4c05-9f58-2818547d2ac0 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:56.732193 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8b887e97-31c2-4c05-9f58-2818547d2ac0 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:56.732633 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8b887e97-31c2-4c05-9f58-2818547d2ac0 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:56.862510 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-8b887e97-31c2-4c05-9f58-2818547d2ac0 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:56.866020 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:03:56.870972 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-8b887e97-31c2-4c05-9f58-2818547d2ac0 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 200 len: 1451 microversion: 2.1 time: 0.151829 Jul 28 04:03:56.871532 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 262/576] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:56 2022] GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:56.891554 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-bf330bd0-8130-4cf8-94b7-41312b84dae0 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:56.892253 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-bf330bd0-8130-4cf8-94b7-41312b84dae0 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:56.898545 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bf330bd0-8130-4cf8-94b7-41312b84dae0 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:56.899028 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bf330bd0-8130-4cf8-94b7-41312b84dae0 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:56.899795 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bf330bd0-8130-4cf8-94b7-41312b84dae0 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:56.900232 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bf330bd0-8130-4cf8-94b7-41312b84dae0 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:57.029798 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-bf330bd0-8130-4cf8-94b7-41312b84dae0 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:57.037726 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-bf330bd0-8130-4cf8-94b7-41312b84dae0 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 200 len: 1451 microversion: 2.1 time: 0.149756 Jul 28 04:03:57.038287 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 315/577] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:56 2022] GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 1451 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:57.560911 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-53967e47-2628-4e78-8d3f-739f7f038a3b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:57.561524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-53967e47-2628-4e78-8d3f-739f7f038a3b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:57.569386 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-53967e47-2628-4e78-8d3f-739f7f038a3b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:57.570099 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-53967e47-2628-4e78-8d3f-739f7f038a3b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:57.570889 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-53967e47-2628-4e78-8d3f-739f7f038a3b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:57.571470 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-53967e47-2628-4e78-8d3f-739f7f038a3b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:57.745055 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-53967e47-2628-4e78-8d3f-739f7f038a3b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:57.755851 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-53967e47-2628-4e78-8d3f-739f7f038a3b tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1681 microversion: 2.1 time: 0.198752 Jul 28 04:03:57.756541 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 263/578] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:57 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1681 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:58.257933 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f3e36d1a-ce7d-4947-84dc-bdf9f9be01cd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4ddd6fc-8893-41bd-927a-c256e0e3e7ee"}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:58.260432 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f3e36d1a-ce7d-4947-84dc-bdf9f9be01cd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:58.267532 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f3e36d1a-ce7d-4947-84dc-bdf9f9be01cd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:58.268364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f3e36d1a-ce7d-4947-84dc-bdf9f9be01cd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:58.269338 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f3e36d1a-ce7d-4947-84dc-bdf9f9be01cd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:58.269778 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f3e36d1a-ce7d-4947-84dc-bdf9f9be01cd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:58.554632 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f3e36d1a-ce7d-4947-84dc-bdf9f9be01cd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "POST /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.300251 Jul 28 04:03:58.561369 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 316/579] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Jul 28 04:03:58 2022] POST /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11/os-volume_attachments => generated 194 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:58.779547 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-188b3330-ab97-4c02-adbf-88959ebe947f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:58.780641 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-188b3330-ab97-4c02-adbf-88959ebe947f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:58.788108 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-188b3330-ab97-4c02-adbf-88959ebe947f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:58.788557 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-188b3330-ab97-4c02-adbf-88959ebe947f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:58.789335 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-188b3330-ab97-4c02-adbf-88959ebe947f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:58.789797 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-188b3330-ab97-4c02-adbf-88959ebe947f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:58.887755 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-188b3330-ab97-4c02-adbf-88959ebe947f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:03:58.896649 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-188b3330-ab97-4c02-adbf-88959ebe947f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 200 len: 1613 microversion: 2.1 time: 0.122384 Jul 28 04:03:58.897237 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 264/580] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:58 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 1613 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:03:59.034872 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-fbdd8974-7a19-4033-aa0f-8b4637270639 req-10445af8-cc45-407b-8e5a-ca6880b87208 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f9103b14-a0f8-40f5-b38b-54b90cae2131", "name": "network-vif-deleted", "tag": "cf1dd0bc-9549-4cae-9755-ef7ec478ee92"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:59.059239 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-fbdd8974-7a19-4033-aa0f-8b4637270639 req-10445af8-cc45-407b-8e5a-ca6880b87208 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:59.059685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-fbdd8974-7a19-4033-aa0f-8b4637270639 req-10445af8-cc45-407b-8e5a-ca6880b87208 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:59.099930 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-fbdd8974-7a19-4033-aa0f-8b4637270639 req-10445af8-cc45-407b-8e5a-ca6880b87208 service nova] Creating event network-vif-deleted:cf1dd0bc-9549-4cae-9755-ef7ec478ee92 for instance f9103b14-a0f8-40f5-b38b-54b90cae2131 on hv-cinder-79987 Jul 28 04:03:59.116772 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-fbdd8974-7a19-4033-aa0f-8b4637270639 req-10445af8-cc45-407b-8e5a-ca6880b87208 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088234 Jul 28 04:03:59.117391 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 317/581] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:59.272344 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-8d714257-e7c0-4655-b2c3-98dcc7bc33a3 req-4b0b4d3f-73b5-4ae8-bebd-23e497fae972 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b73f1a1-e07f-4ebe-af69-e188924a9073", "tag": "8f78dd8c-353e-4f87-bef6-e8bc130d65a0"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:03:59.283261 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-8d714257-e7c0-4655-b2c3-98dcc7bc33a3 req-4b0b4d3f-73b5-4ae8-bebd-23e497fae972 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:59.284012 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-8d714257-e7c0-4655-b2c3-98dcc7bc33a3 req-4b0b4d3f-73b5-4ae8-bebd-23e497fae972 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:59.299937 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-8d714257-e7c0-4655-b2c3-98dcc7bc33a3 req-4b0b4d3f-73b5-4ae8-bebd-23e497fae972 service nova] Creating event network-changed:8f78dd8c-353e-4f87-bef6-e8bc130d65a0 for instance 5b73f1a1-e07f-4ebe-af69-e188924a9073 on hv-cinder-79987 Jul 28 04:03:59.305117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-8d714257-e7c0-4655-b2c3-98dcc7bc33a3 req-4b0b4d3f-73b5-4ae8-bebd-23e497fae972 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036621 Jul 28 04:03:59.305911 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 265/582] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:03:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:03:59.918851 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-eaf79019-1cfb-4532-bfca-0c7a2500c205 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:59.920228 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-eaf79019-1cfb-4532-bfca-0c7a2500c205 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:03:59.928002 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-eaf79019-1cfb-4532-bfca-0c7a2500c205 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:59.928694 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-eaf79019-1cfb-4532-bfca-0c7a2500c205 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:59.929627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-eaf79019-1cfb-4532-bfca-0c7a2500c205 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:03:59.930063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-eaf79019-1cfb-4532-bfca-0c7a2500c205 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:03:59.944159 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-eaf79019-1cfb-4532-bfca-0c7a2500c205 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] HTTP exception thrown: Instance f9103b14-a0f8-40f5-b38b-54b90cae2131 could not be found. Jul 28 04:03:59.946201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-eaf79019-1cfb-4532-bfca-0c7a2500c205 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Request method failure captured: Jul 28 04:03:59.946201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 HTTP/1.1 Jul 28 04:03:59.946201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:03:59.946201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:03:59.946201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:03:59.946201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:03:59.946201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:03:59.946201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:03:59.946201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:03:59.946201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:03:59.946201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gmoXQtNoyNZeVOBtHeH0p0IZl6gLmXu7uMplYaqMcIU3TXk6NAztCb7-3xvXPbqffriel8JQiqKAHgD2FYfvE1RoXCiUMTvpIZjixGVtBiBXhQr6lOIK0tmH4bMvCgHENHbbkhJpWpz1XJYt5CJBH3JqJi5ypO8pp_YsE0VFSnKOUI Jul 28 04:03:59.946201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:03:59.946201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:03:59.946201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:03:59.946201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:03:59.946201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:03:59.946201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:03:59.946201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:03:59.946201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:03:59.946201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:03:59.946201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:03:59.947566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_18a927e9f5da42d7b34752c8b2db211a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/18a927e9f5da42d7b34752c8b2db211a"}]}] Jul 28 04:03:59.947566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:03:59.947566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:03:59.947566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:03:59.947566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:03:59.947566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:03:59.947566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:03:59.947566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: c3308761e9d2495e95e127bbc7b9c5e2 Jul 28 04:03:59.947566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:03:59.947566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:03:59.947566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Instance f9103b14-a0f8-40f5-b38b-54b90cae2131 could not be found. Jul 28 04:03:59.947566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': 'f9103b14-a0f8-40f5-b38b-54b90cae2131'} Jul 28 04:03:59.948275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:03:59.948275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:59.948275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:03:59.948275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:03:59.948275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:03:59.948275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:03:59.948275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:03:59.948275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:03:59.948275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:03:59.948275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:03:59.948275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9103b14-a0f8-40f5-b38b-54b90cae2131 could not be found. Jul 28 04:03:59.948275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:03:59.948275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:03:59.948275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:03:59.948275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:59.948275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:03:59.948275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:03:59.948275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:03:59.948275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:03:59.948275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:03:59.949462 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:03:59.949462 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:03:59.949462 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:03:59.949462 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:03:59.949462 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:03:59.949462 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:03:59.949462 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:03:59.949462 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9103b14-a0f8-40f5-b38b-54b90cae2131 could not be found. Jul 28 04:03:59.949462 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:03:59.949462 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:03:59.949462 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:03:59.949462 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:03:59.949462 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:03:59.949462 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:03:59.949462 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:03:59.949462 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:03:59.949462 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9103b14-a0f8-40f5-b38b-54b90cae2131 could not be found. Jul 28 04:03:59.949462 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:03:59.950506 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-eaf79019-1cfb-4532-bfca-0c7a2500c205 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Returning 404 to user: Instance f9103b14-a0f8-40f5-b38b-54b90cae2131 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:03:59.950506 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-eaf79019-1cfb-4532-bfca-0c7a2500c205 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 404 len: 111 microversion: 2.1 time: 0.033586 Jul 28 04:03:59.950506 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 318/583] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:03:59 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:03:59.958136 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-89c1921c-a1d1-42d9-847d-a715800e0044 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '.version_select at 0x7fa6ee12a1f0>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:03:59.988269 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-89c1921c-a1d1-42d9-847d-a715800e0044 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1655261939" status: 202 len: 0 microversion: 2.1 time: 0.034701 Jul 28 04:03:59.989716 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 266/584] 10.222.0.46 () {58 vars in 1221 bytes} [Thu Jul 28 04:03:59 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1655261939 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:04:00.726096 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3c7bedb0-2e0b-4df9-8e10-410bf947ce27 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Action: 'create', calling method: .version_select at 0x7fa6ee0dfd30>, body: {"keypair": {"name": "tempest-keypair-1612336144", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAxlxw5XxQcyIjGnDl5E276RvZmFuV3bkWAeyuN4ECPMwFgOCjY2uTmGTiJ7DWkO4/0xn+pSIDvejU218njtHPabSskH+2g+mt1D5et0sHnDYU0VGmp24r8afWFG9DS3pQ=="}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:00.741720 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-3c7bedb0-2e0b-4df9-8e10-410bf947ce27 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Getting quotas for project 18a927e9f5da42d7b34752c8b2db211a. Resources: {'key_pairs'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:04:00.745589 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-3c7bedb0-2e0b-4df9-8e10-410bf947ce27 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Getting quotas for user c3308761e9d2495e95e127bbc7b9c5e2 and project 18a927e9f5da42d7b34752c8b2db211a. Resources: {'key_pairs'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:04:00.769085 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3c7bedb0-2e0b-4df9-8e10-410bf947ce27 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.046916 Jul 28 04:04:00.769688 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 319/585] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 04:04:00 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:02.045906 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-0208ed8c-7f98-41d9-9410-ef12d95ce6b0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-489821297", "imageRef": "a0eec51c-83e9-420b-bcb9-20fe8dcf5321", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21c60ecd-c113-4857-a1b5-c85ec6a7053f"}], "security_groups": [{"name": "tempest-securitygroup--1770513923"}], "key_name": "tempest-keypair-1612336144", "user_data": "}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:02.149976 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.network.neutron [None req-0208ed8c-7f98-41d9-9410-ef12d95ce6b0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] validate_networks() for [('21c60ecd-c113-4857-a1b5-c85ec6a7053f', None, None, None, None, None)] {{(pid=118186) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:04:02.522696 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-0208ed8c-7f98-41d9-9410-ef12d95ce6b0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Flavor limits 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:04:02.523168 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-0208ed8c-7f98-41d9-9410-ef12d95ce6b0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Image limits 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:04:02.523676 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-0208ed8c-7f98-41d9-9410-ef12d95ce6b0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Flavor pref 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:04:02.524086 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-0208ed8c-7f98-41d9-9410-ef12d95ce6b0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Image pref 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:04:02.524499 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-0208ed8c-7f98-41d9-9410-ef12d95ce6b0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:04:02.533318 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0208ed8c-7f98-41d9-9410-ef12d95ce6b0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:02.533775 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0208ed8c-7f98-41d9-9410-ef12d95ce6b0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:02.534580 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0208ed8c-7f98-41d9-9410-ef12d95ce6b0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:02.535060 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0208ed8c-7f98-41d9-9410-ef12d95ce6b0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:02.552583 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-0208ed8c-7f98-41d9-9410-ef12d95ce6b0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Getting quotas for project 18a927e9f5da42d7b34752c8b2db211a. Resources: {'instances', 'cores', 'ram'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:04:02.556590 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-0208ed8c-7f98-41d9-9410-ef12d95ce6b0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Getting quotas for user c3308761e9d2495e95e127bbc7b9c5e2 and project 18a927e9f5da42d7b34752c8b2db211a. Resources: {'instances', 'cores', 'ram'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:04:02.568217 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-0208ed8c-7f98-41d9-9410-ef12d95ce6b0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Going to run 1 instances... {{(pid=118186) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:04:02.570588 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-0208ed8c-7f98-41d9-9410-ef12d95ce6b0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0eec51c-83e9-420b-bcb9-20fe8dcf5321',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:04:02.616089 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-0208ed8c-7f98-41d9-9410-ef12d95ce6b0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.574897 Jul 28 04:04:02.616662 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 267/586] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 04:04:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 576 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:04:02.628688 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-64c15a28-594f-42b8-9d7a-01ae4c76021e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:02.629388 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-64c15a28-594f-42b8-9d7a-01ae4c76021e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:02.685077 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-64c15a28-594f-42b8-9d7a-01ae4c76021e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:02.692435 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-64c15a28-594f-42b8-9d7a-01ae4c76021e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7" status: 200 len: 1241 microversion: 2.1 time: 0.068806 Jul 28 04:04:02.693015 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 320/587] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:02 2022] GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7 => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:03.713716 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-595a3249-3571-499d-be0b-d60d1964eebc tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:03.714343 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-595a3249-3571-499d-be0b-d60d1964eebc tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:03.720887 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-595a3249-3571-499d-be0b-d60d1964eebc tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:03.721334 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-595a3249-3571-499d-be0b-d60d1964eebc tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:03.722096 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-595a3249-3571-499d-be0b-d60d1964eebc tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:03.722533 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-595a3249-3571-499d-be0b-d60d1964eebc tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:03.792568 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-595a3249-3571-499d-be0b-d60d1964eebc tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:03.800632 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-595a3249-3571-499d-be0b-d60d1964eebc tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7" status: 200 len: 1299 microversion: 2.1 time: 0.091206 Jul 28 04:04:03.801205 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 268/588] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:03 2022] GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7 => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:04.821593 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-21bdcff6-b04d-4511-9122-d5f44c2eb886 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:04.822350 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-21bdcff6-b04d-4511-9122-d5f44c2eb886 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:04.828845 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-21bdcff6-b04d-4511-9122-d5f44c2eb886 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:04.829330 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-21bdcff6-b04d-4511-9122-d5f44c2eb886 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:04.831071 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-21bdcff6-b04d-4511-9122-d5f44c2eb886 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:04.831513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-21bdcff6-b04d-4511-9122-d5f44c2eb886 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:04.967321 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-21bdcff6-b04d-4511-9122-d5f44c2eb886 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:04.980129 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-21bdcff6-b04d-4511-9122-d5f44c2eb886 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7" status: 200 len: 1367 microversion: 2.1 time: 0.162086 Jul 28 04:04:04.981197 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 321/589] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:04 2022] GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:05.270243 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-25556141-d291-407f-a141-2988a493eff8 req-65551112-19f1-42ab-9ab8-ffb8f233919c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317bde19-5d15-4691-b014-3e2d001184e7", "tag": "4e24c96f-28ee-4033-a629-7e7de2eef4db"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:05.289368 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-25556141-d291-407f-a141-2988a493eff8 req-65551112-19f1-42ab-9ab8-ffb8f233919c service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:05.289821 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-25556141-d291-407f-a141-2988a493eff8 req-65551112-19f1-42ab-9ab8-ffb8f233919c service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:05.302662 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-25556141-d291-407f-a141-2988a493eff8 req-65551112-19f1-42ab-9ab8-ffb8f233919c service nova] Creating event network-changed:4e24c96f-28ee-4033-a629-7e7de2eef4db for instance 317bde19-5d15-4691-b014-3e2d001184e7 on hv-cinder-79987 Jul 28 04:04:05.308279 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-25556141-d291-407f-a141-2988a493eff8 req-65551112-19f1-42ab-9ab8-ffb8f233919c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042095 Jul 28 04:04:05.309240 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 269/590] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:04:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:06.004275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ca718b65-3465-450f-b82a-67ff84a461d0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:06.004916 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ca718b65-3465-450f-b82a-67ff84a461d0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:06.011720 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ca718b65-3465-450f-b82a-67ff84a461d0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:06.012192 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ca718b65-3465-450f-b82a-67ff84a461d0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:06.012950 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ca718b65-3465-450f-b82a-67ff84a461d0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:06.013382 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ca718b65-3465-450f-b82a-67ff84a461d0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:06.018232 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:06.147944 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ca718b65-3465-450f-b82a-67ff84a461d0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:06.155562 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ca718b65-3465-450f-b82a-67ff84a461d0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7" status: 200 len: 1367 microversion: 2.1 time: 0.156002 Jul 28 04:04:06.156124 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 322/591] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:05 2022] GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:06.170936 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-0b5dac6b-94cc-4f64-b436-4dc7bb4837c9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:06.173308 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-0b5dac6b-94cc-4f64-b436-4dc7bb4837c9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:06.179642 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0b5dac6b-94cc-4f64-b436-4dc7bb4837c9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:06.180103 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0b5dac6b-94cc-4f64-b436-4dc7bb4837c9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:06.180865 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0b5dac6b-94cc-4f64-b436-4dc7bb4837c9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:06.181307 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0b5dac6b-94cc-4f64-b436-4dc7bb4837c9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:06.204991 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.objects.instance [None req-0b5dac6b-94cc-4f64-b436-4dc7bb4837c9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lazy-loading 'flavor' on Instance uuid fe24f923-0389-4154-a7bb-062800043d11 {{(pid=118186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:04:06.363451 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-0b5dac6b-94cc-4f64-b436-4dc7bb4837c9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "POST /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11/action" status: 200 len: 32 microversion: 2.1 time: 0.196806 Jul 28 04:04:06.364080 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 270/592] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Jul 28 04:04:06 2022] POST /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11/action => generated 32 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:04:06.373394 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6dcd0470-13ba-49b8-85ba-8653a5f0f8fa tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:06.374019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6dcd0470-13ba-49b8-85ba-8653a5f0f8fa tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:06.380270 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6dcd0470-13ba-49b8-85ba-8653a5f0f8fa tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:06.380716 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6dcd0470-13ba-49b8-85ba-8653a5f0f8fa tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:06.381472 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6dcd0470-13ba-49b8-85ba-8653a5f0f8fa tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:06.381900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6dcd0470-13ba-49b8-85ba-8653a5f0f8fa tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:06.512055 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6dcd0470-13ba-49b8-85ba-8653a5f0f8fa tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:06.520029 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6dcd0470-13ba-49b8-85ba-8653a5f0f8fa tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1736 microversion: 2.1 time: 0.150498 Jul 28 04:04:06.520526 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 323/593] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:06 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:07.177598 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-9cb3905c-9cec-4412-b1ab-5badb477fa52 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:07.178236 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-9cb3905c-9cec-4412-b1ab-5badb477fa52 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:07.184522 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9cb3905c-9cec-4412-b1ab-5badb477fa52 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:07.184974 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9cb3905c-9cec-4412-b1ab-5badb477fa52 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:07.185751 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9cb3905c-9cec-4412-b1ab-5badb477fa52 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:07.186188 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9cb3905c-9cec-4412-b1ab-5badb477fa52 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:07.488653 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-9cb3905c-9cec-4412-b1ab-5badb477fa52 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:07.496145 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-9cb3905c-9cec-4412-b1ab-5badb477fa52 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7" status: 200 len: 1367 microversion: 2.1 time: 0.322930 Jul 28 04:04:07.496912 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 271/594] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:07 2022] GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7 => generated 1367 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:07.541973 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-cb4af96f-d7b1-4fec-9daf-d4ca87cfa129 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:07.543959 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-cb4af96f-d7b1-4fec-9daf-d4ca87cfa129 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:07.551955 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cb4af96f-d7b1-4fec-9daf-d4ca87cfa129 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:07.552131 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cb4af96f-d7b1-4fec-9daf-d4ca87cfa129 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:07.553186 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cb4af96f-d7b1-4fec-9daf-d4ca87cfa129 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:07.553308 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cb4af96f-d7b1-4fec-9daf-d4ca87cfa129 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:07.691623 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-cb4af96f-d7b1-4fec-9daf-d4ca87cfa129 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:07.699637 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-cb4af96f-d7b1-4fec-9daf-d4ca87cfa129 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1736 microversion: 2.1 time: 0.161813 Jul 28 04:04:07.700206 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 324/595] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:07 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:08.517464 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-4efb6729-667e-4c79-82f7-161a48a1f720 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:08.518082 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-4efb6729-667e-4c79-82f7-161a48a1f720 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:08.524567 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4efb6729-667e-4c79-82f7-161a48a1f720 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:08.525012 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4efb6729-667e-4c79-82f7-161a48a1f720 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:08.525760 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4efb6729-667e-4c79-82f7-161a48a1f720 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:08.526189 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4efb6729-667e-4c79-82f7-161a48a1f720 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:08.658435 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-4efb6729-667e-4c79-82f7-161a48a1f720 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:08.666115 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-4efb6729-667e-4c79-82f7-161a48a1f720 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7" status: 200 len: 1367 microversion: 2.1 time: 0.152483 Jul 28 04:04:08.666693 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 272/596] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:08 2022] GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:08.720746 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-476fc0bf-647b-409d-aa4c-f3393be70787 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:08.721363 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-476fc0bf-647b-409d-aa4c-f3393be70787 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:08.727886 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-476fc0bf-647b-409d-aa4c-f3393be70787 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:08.728342 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-476fc0bf-647b-409d-aa4c-f3393be70787 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:08.729109 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-476fc0bf-647b-409d-aa4c-f3393be70787 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:08.729549 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-476fc0bf-647b-409d-aa4c-f3393be70787 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:08.862008 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-476fc0bf-647b-409d-aa4c-f3393be70787 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:08.869999 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-476fc0bf-647b-409d-aa4c-f3393be70787 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1736 microversion: 2.1 time: 0.153329 Jul 28 04:04:08.870561 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 325/597] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:08 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:09.687180 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-63dd1b8a-5ff3-4cdd-881a-5220cc18f8ac tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:09.687715 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-63dd1b8a-5ff3-4cdd-881a-5220cc18f8ac tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:09.694532 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-63dd1b8a-5ff3-4cdd-881a-5220cc18f8ac tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:09.695015 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-63dd1b8a-5ff3-4cdd-881a-5220cc18f8ac tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:09.695772 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-63dd1b8a-5ff3-4cdd-881a-5220cc18f8ac tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:09.696195 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-63dd1b8a-5ff3-4cdd-881a-5220cc18f8ac tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:09.825768 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-63dd1b8a-5ff3-4cdd-881a-5220cc18f8ac tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:09.833897 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-63dd1b8a-5ff3-4cdd-881a-5220cc18f8ac tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7" status: 200 len: 1367 microversion: 2.1 time: 0.150645 Jul 28 04:04:09.834474 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 273/598] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:09 2022] GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:09.892240 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-1b122c20-c23d-451d-a628-d527e779e3db tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:09.892866 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-1b122c20-c23d-451d-a628-d527e779e3db tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:09.899681 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1b122c20-c23d-451d-a628-d527e779e3db tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:09.900133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1b122c20-c23d-451d-a628-d527e779e3db tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:09.900896 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1b122c20-c23d-451d-a628-d527e779e3db tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:09.901332 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1b122c20-c23d-451d-a628-d527e779e3db tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:10.029487 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1b122c20-c23d-451d-a628-d527e779e3db tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:10.038280 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-1b122c20-c23d-451d-a628-d527e779e3db tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1736 microversion: 2.1 time: 0.150466 Jul 28 04:04:10.038869 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 326/599] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:09 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:10.854575 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-98a5bd48-9733-4e13-84b4-a0cc71f231a0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:10.855222 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-98a5bd48-9733-4e13-84b4-a0cc71f231a0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:10.862562 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-98a5bd48-9733-4e13-84b4-a0cc71f231a0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:10.863041 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-98a5bd48-9733-4e13-84b4-a0cc71f231a0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:10.863830 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-98a5bd48-9733-4e13-84b4-a0cc71f231a0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:10.864260 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-98a5bd48-9733-4e13-84b4-a0cc71f231a0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:10.999085 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-98a5bd48-9733-4e13-84b4-a0cc71f231a0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:11.006634 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-98a5bd48-9733-4e13-84b4-a0cc71f231a0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7" status: 200 len: 1367 microversion: 2.1 time: 0.155929 Jul 28 04:04:11.007234 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 274/600] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:10 2022] GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:11.059584 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-73f1e5d2-05e0-498c-92d6-189f035d6c30 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:11.060200 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-73f1e5d2-05e0-498c-92d6-189f035d6c30 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:11.067039 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-73f1e5d2-05e0-498c-92d6-189f035d6c30 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:11.067358 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-73f1e5d2-05e0-498c-92d6-189f035d6c30 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:11.068115 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-73f1e5d2-05e0-498c-92d6-189f035d6c30 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:11.068549 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-73f1e5d2-05e0-498c-92d6-189f035d6c30 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:11.195757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-73f1e5d2-05e0-498c-92d6-189f035d6c30 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:11.203675 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-73f1e5d2-05e0-498c-92d6-189f035d6c30 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1736 microversion: 2.1 time: 0.147935 Jul 28 04:04:11.204748 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 327/601] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:11 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1736 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:11.397403 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-5c3efa51-1519-48ab-ac64-8b29dd0f08f2 req-70d417d1-d847-47a1-bfca-ca1a62eff1aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317bde19-5d15-4691-b014-3e2d001184e7", "name": "network-vif-plugged", "status": "completed", "tag": "4e24c96f-28ee-4033-a629-7e7de2eef4db"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:11.409287 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-5c3efa51-1519-48ab-ac64-8b29dd0f08f2 req-70d417d1-d847-47a1-bfca-ca1a62eff1aa service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:11.409739 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-5c3efa51-1519-48ab-ac64-8b29dd0f08f2 req-70d417d1-d847-47a1-bfca-ca1a62eff1aa service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:11.422616 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-5c3efa51-1519-48ab-ac64-8b29dd0f08f2 req-70d417d1-d847-47a1-bfca-ca1a62eff1aa service nova] Creating event network-vif-plugged:4e24c96f-28ee-4033-a629-7e7de2eef4db for instance 317bde19-5d15-4691-b014-3e2d001184e7 on hv-cinder-79987 Jul 28 04:04:11.427817 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-5c3efa51-1519-48ab-ac64-8b29dd0f08f2 req-70d417d1-d847-47a1-bfca-ca1a62eff1aa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034178 Jul 28 04:04:11.428417 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 275/602] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:04:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:04:12.031208 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6dd42707-836c-414d-a4b1-430995a81b19 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:12.031830 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6dd42707-836c-414d-a4b1-430995a81b19 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:12.038725 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6dd42707-836c-414d-a4b1-430995a81b19 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:12.039216 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6dd42707-836c-414d-a4b1-430995a81b19 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:12.039954 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6dd42707-836c-414d-a4b1-430995a81b19 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:12.040388 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6dd42707-836c-414d-a4b1-430995a81b19 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:12.170525 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6dd42707-836c-414d-a4b1-430995a81b19 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:12.178034 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6dd42707-836c-414d-a4b1-430995a81b19 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7" status: 200 len: 1367 microversion: 2.1 time: 0.151199 Jul 28 04:04:12.178595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 328/603] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:12 2022] GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:12.226390 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a5d8fee7-eac7-4ffb-8eab-ab95b624c01a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:12.227126 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-a5d8fee7-eac7-4ffb-8eab-ab95b624c01a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:12.233816 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a5d8fee7-eac7-4ffb-8eab-ab95b624c01a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:12.234264 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a5d8fee7-eac7-4ffb-8eab-ab95b624c01a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:12.235055 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a5d8fee7-eac7-4ffb-8eab-ab95b624c01a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:12.235493 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a5d8fee7-eac7-4ffb-8eab-ab95b624c01a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:12.364213 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-a5d8fee7-eac7-4ffb-8eab-ab95b624c01a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:12.372190 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-a5d8fee7-eac7-4ffb-8eab-ab95b624c01a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1736 microversion: 2.1 time: 0.149989 Jul 28 04:04:12.372754 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 276/604] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:12 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:13.198373 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2858ecb2-9d20-4208-8f41-104e1ab962b8 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:13.199019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-2858ecb2-9d20-4208-8f41-104e1ab962b8 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:13.200844 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=6 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:13.206684 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2858ecb2-9d20-4208-8f41-104e1ab962b8 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:13.207164 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2858ecb2-9d20-4208-8f41-104e1ab962b8 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:13.207960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2858ecb2-9d20-4208-8f41-104e1ab962b8 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:13.208401 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2858ecb2-9d20-4208-8f41-104e1ab962b8 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:13.338747 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-2858ecb2-9d20-4208-8f41-104e1ab962b8 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:13.347813 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-2858ecb2-9d20-4208-8f41-104e1ab962b8 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7" status: 200 len: 1367 microversion: 2.1 time: 0.153097 Jul 28 04:04:13.348469 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 329/605] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:13 2022] GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:13.393953 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-e1212a1d-68a1-409e-a82a-caba10911548 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:13.394585 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-e1212a1d-68a1-409e-a82a-caba10911548 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:13.396570 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell0:SELECT=2 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:13.397236 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell0:SELECT=6 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:13.403730 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e1212a1d-68a1-409e-a82a-caba10911548 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:13.404183 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e1212a1d-68a1-409e-a82a-caba10911548 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:13.404948 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e1212a1d-68a1-409e-a82a-caba10911548 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:13.405386 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e1212a1d-68a1-409e-a82a-caba10911548 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:13.536236 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-e1212a1d-68a1-409e-a82a-caba10911548 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:13.545569 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-e1212a1d-68a1-409e-a82a-caba10911548 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1736 microversion: 2.1 time: 0.155942 Jul 28 04:04:13.546153 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 277/606] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:13 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:14.368893 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a7f59bef-19e2-4a92-8f56-848757cd4d95 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:14.369539 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a7f59bef-19e2-4a92-8f56-848757cd4d95 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:14.376078 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7f59bef-19e2-4a92-8f56-848757cd4d95 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:14.376522 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7f59bef-19e2-4a92-8f56-848757cd4d95 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:14.377504 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7f59bef-19e2-4a92-8f56-848757cd4d95 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:14.378082 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7f59bef-19e2-4a92-8f56-848757cd4d95 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:14.511628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a7f59bef-19e2-4a92-8f56-848757cd4d95 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:14.519920 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a7f59bef-19e2-4a92-8f56-848757cd4d95 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7" status: 200 len: 1557 microversion: 2.1 time: 0.154908 Jul 28 04:04:14.520510 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 330/607] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:14 2022] GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7 => generated 1557 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:14.540351 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-691a1a15-10f2-4106-95ce-9157961fb29a tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:14.540852 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-691a1a15-10f2-4106-95ce-9157961fb29a tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:14.547373 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-691a1a15-10f2-4106-95ce-9157961fb29a tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:14.547848 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-691a1a15-10f2-4106-95ce-9157961fb29a tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:14.548616 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-691a1a15-10f2-4106-95ce-9157961fb29a tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:14.549104 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-691a1a15-10f2-4106-95ce-9157961fb29a tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:14.568538 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ea581547-2434-445d-97c2-f452f1df6dba tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:14.569181 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ea581547-2434-445d-97c2-f452f1df6dba tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:14.575165 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ea581547-2434-445d-97c2-f452f1df6dba tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:14.575626 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ea581547-2434-445d-97c2-f452f1df6dba tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:14.576404 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ea581547-2434-445d-97c2-f452f1df6dba tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:14.576842 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ea581547-2434-445d-97c2-f452f1df6dba tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:14.627738 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-691a1a15-10f2-4106-95ce-9157961fb29a tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.090803 Jul 28 04:04:14.628332 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 278/608] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Jul 28 04:04:14 2022] GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:14.709523 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ea581547-2434-445d-97c2-f452f1df6dba tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:14.717521 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ea581547-2434-445d-97c2-f452f1df6dba tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1736 microversion: 2.1 time: 0.153564 Jul 28 04:04:14.718290 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 331/609] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:14 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:15.741107 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-07ee27c6-7ecd-482d-b250-3500eb3de429 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:15.741981 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-07ee27c6-7ecd-482d-b250-3500eb3de429 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:15.748292 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-07ee27c6-7ecd-482d-b250-3500eb3de429 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:15.748746 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-07ee27c6-7ecd-482d-b250-3500eb3de429 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:15.749517 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-07ee27c6-7ecd-482d-b250-3500eb3de429 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:15.749952 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-07ee27c6-7ecd-482d-b250-3500eb3de429 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:15.860004 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-3512b39e-5e08-40d6-b991-c9e70386e685 req-d71eb8c7-a094-4dca-b6b6-407045abf8f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "317bde19-5d15-4691-b014-3e2d001184e7", "tag": "4e24c96f-28ee-4033-a629-7e7de2eef4db"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:15.872235 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-3512b39e-5e08-40d6-b991-c9e70386e685 req-d71eb8c7-a094-4dca-b6b6-407045abf8f4 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:15.872688 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-3512b39e-5e08-40d6-b991-c9e70386e685 req-d71eb8c7-a094-4dca-b6b6-407045abf8f4 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:15.885186 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-3512b39e-5e08-40d6-b991-c9e70386e685 req-d71eb8c7-a094-4dca-b6b6-407045abf8f4 service nova] Creating event network-changed:4e24c96f-28ee-4033-a629-7e7de2eef4db for instance 317bde19-5d15-4691-b014-3e2d001184e7 on hv-cinder-79987 Jul 28 04:04:15.890175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-3512b39e-5e08-40d6-b991-c9e70386e685 req-d71eb8c7-a094-4dca-b6b6-407045abf8f4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033773 Jul 28 04:04:15.890772 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 332/610] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:04:15.926526 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-07ee27c6-7ecd-482d-b250-3500eb3de429 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:15.935976 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-07ee27c6-7ecd-482d-b250-3500eb3de429 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1736 microversion: 2.1 time: 0.199724 Jul 28 04:04:15.936753 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 279/611] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:15 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1736 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:16.958512 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5f4dc0ff-3dab-42ab-b4f6-f92261c86beb tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:16.959247 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5f4dc0ff-3dab-42ab-b4f6-f92261c86beb tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:16.961178 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=88,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:16.966581 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f4dc0ff-3dab-42ab-b4f6-f92261c86beb tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:16.967057 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f4dc0ff-3dab-42ab-b4f6-f92261c86beb tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:16.967817 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f4dc0ff-3dab-42ab-b4f6-f92261c86beb tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:16.968250 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f4dc0ff-3dab-42ab-b4f6-f92261c86beb tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:17.099586 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5f4dc0ff-3dab-42ab-b4f6-f92261c86beb tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:17.107427 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5f4dc0ff-3dab-42ab-b4f6-f92261c86beb tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1736 microversion: 2.1 time: 0.153693 Jul 28 04:04:17.107989 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 333/612] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:16 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:18.129265 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-f2dc69b3-7b43-4d5e-b443-7581d4bb4243 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:18.129880 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-f2dc69b3-7b43-4d5e-b443-7581d4bb4243 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:18.136424 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f2dc69b3-7b43-4d5e-b443-7581d4bb4243 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:18.136871 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f2dc69b3-7b43-4d5e-b443-7581d4bb4243 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:18.137626 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f2dc69b3-7b43-4d5e-b443-7581d4bb4243 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:18.138060 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f2dc69b3-7b43-4d5e-b443-7581d4bb4243 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:18.273362 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-f2dc69b3-7b43-4d5e-b443-7581d4bb4243 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:18.281223 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-f2dc69b3-7b43-4d5e-b443-7581d4bb4243 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1736 microversion: 2.1 time: 0.156282 Jul 28 04:04:18.281785 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 280/613] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:18 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:19.303793 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5a463882-4132-4396-a4bb-dc93dbb97c21 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:19.304436 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5a463882-4132-4396-a4bb-dc93dbb97c21 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:19.311178 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5a463882-4132-4396-a4bb-dc93dbb97c21 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:19.311625 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5a463882-4132-4396-a4bb-dc93dbb97c21 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:19.312386 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5a463882-4132-4396-a4bb-dc93dbb97c21 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:19.312819 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5a463882-4132-4396-a4bb-dc93dbb97c21 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:19.443757 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5a463882-4132-4396-a4bb-dc93dbb97c21 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:19.451616 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5a463882-4132-4396-a4bb-dc93dbb97c21 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1736 microversion: 2.1 time: 0.151700 Jul 28 04:04:19.452184 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 334/614] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:19 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:20.472726 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-99df1ea8-44a0-4fa6-bd20-52fedb22869d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:20.473341 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-99df1ea8-44a0-4fa6-bd20-52fedb22869d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:20.479972 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-99df1ea8-44a0-4fa6-bd20-52fedb22869d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:20.480425 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-99df1ea8-44a0-4fa6-bd20-52fedb22869d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:20.481183 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-99df1ea8-44a0-4fa6-bd20-52fedb22869d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:20.481626 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-99df1ea8-44a0-4fa6-bd20-52fedb22869d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:20.501791 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:20.615006 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-99df1ea8-44a0-4fa6-bd20-52fedb22869d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:20.622846 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-99df1ea8-44a0-4fa6-bd20-52fedb22869d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1736 microversion: 2.1 time: 0.154500 Jul 28 04:04:20.623406 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 281/615] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:20 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:21.645484 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b445446d-2973-4b33-93dd-647662ccafa5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:21.646099 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b445446d-2973-4b33-93dd-647662ccafa5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:21.652663 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b445446d-2973-4b33-93dd-647662ccafa5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:21.653110 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b445446d-2973-4b33-93dd-647662ccafa5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:21.653872 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b445446d-2973-4b33-93dd-647662ccafa5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:21.654307 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b445446d-2973-4b33-93dd-647662ccafa5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:21.785202 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b445446d-2973-4b33-93dd-647662ccafa5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:21.793457 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b445446d-2973-4b33-93dd-647662ccafa5 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1736 microversion: 2.1 time: 0.152707 Jul 28 04:04:21.794059 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 335/616] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:21 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:22.814300 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-7d03c156-4cc4-4c82-8852-596e5a004efc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:22.815038 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-7d03c156-4cc4-4c82-8852-596e5a004efc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:22.821463 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7d03c156-4cc4-4c82-8852-596e5a004efc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:22.821903 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7d03c156-4cc4-4c82-8852-596e5a004efc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:22.822652 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7d03c156-4cc4-4c82-8852-596e5a004efc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:22.823105 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7d03c156-4cc4-4c82-8852-596e5a004efc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:22.956001 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-7d03c156-4cc4-4c82-8852-596e5a004efc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:22.963901 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-7d03c156-4cc4-4c82-8852-596e5a004efc tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1736 microversion: 2.1 time: 0.153454 Jul 28 04:04:22.964471 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 282/617] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:22 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:23.986448 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ade93e9f-8b0b-4d9e-875d-06069aff998d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:23.987429 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ade93e9f-8b0b-4d9e-875d-06069aff998d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:23.993967 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ade93e9f-8b0b-4d9e-875d-06069aff998d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:23.994419 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ade93e9f-8b0b-4d9e-875d-06069aff998d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:23.995215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ade93e9f-8b0b-4d9e-875d-06069aff998d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:23.995655 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ade93e9f-8b0b-4d9e-875d-06069aff998d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:24.127690 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ade93e9f-8b0b-4d9e-875d-06069aff998d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:24.135618 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ade93e9f-8b0b-4d9e-875d-06069aff998d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1736 microversion: 2.1 time: 0.153198 Jul 28 04:04:24.136196 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 336/618] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:23 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:25.160463 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-3c185948-4687-49ae-bbb6-3d31319ecea6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:25.161077 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-3c185948-4687-49ae-bbb6-3d31319ecea6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:25.163843 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:25.169592 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3c185948-4687-49ae-bbb6-3d31319ecea6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:25.170201 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3c185948-4687-49ae-bbb6-3d31319ecea6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:25.171006 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3c185948-4687-49ae-bbb6-3d31319ecea6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:25.171448 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3c185948-4687-49ae-bbb6-3d31319ecea6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:25.345639 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-3c185948-4687-49ae-bbb6-3d31319ecea6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:25.353216 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-3c185948-4687-49ae-bbb6-3d31319ecea6 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1736 microversion: 2.1 time: 0.198143 Jul 28 04:04:25.353809 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 283/619] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:25 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1736 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:26.377224 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-91e64aba-fe70-4e9b-a6c2-ff24aac404cf tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:26.378107 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-91e64aba-fe70-4e9b-a6c2-ff24aac404cf tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:26.386091 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-91e64aba-fe70-4e9b-a6c2-ff24aac404cf tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:26.386552 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-91e64aba-fe70-4e9b-a6c2-ff24aac404cf tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:26.387357 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-91e64aba-fe70-4e9b-a6c2-ff24aac404cf tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:26.387802 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-91e64aba-fe70-4e9b-a6c2-ff24aac404cf tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:26.517199 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-91e64aba-fe70-4e9b-a6c2-ff24aac404cf tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:26.525664 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-91e64aba-fe70-4e9b-a6c2-ff24aac404cf tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1716 microversion: 2.1 time: 0.153948 Jul 28 04:04:26.526229 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 337/620] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:26 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1716 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:26.635297 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-f373c2b1-31cc-4ee1-9a0c-3a47acad9bdd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:26.635820 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-f373c2b1-31cc-4ee1-9a0c-3a47acad9bdd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:26.642265 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f373c2b1-31cc-4ee1-9a0c-3a47acad9bdd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:26.642726 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f373c2b1-31cc-4ee1-9a0c-3a47acad9bdd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:26.643531 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f373c2b1-31cc-4ee1-9a0c-3a47acad9bdd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:26.643971 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f373c2b1-31cc-4ee1-9a0c-3a47acad9bdd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:26.723909 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.wsgi [None req-f373c2b1-31cc-4ee1-9a0c-3a47acad9bdd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] HTTP exception thrown: Cannot 'detach_volume' instance fe24f923-0389-4154-a7bb-062800043d11 while it is in vm_state rescued Jul 28 04:04:26.725505 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-f373c2b1-31cc-4ee1-9a0c-3a47acad9bdd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Request method failure captured: Jul 28 04:04:26.725505 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: request: DELETE /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11/os-volume_attachments/f4ddd6fc-8893-41bd-927a-c256e0e3e7ee HTTP/1.1 Jul 28 04:04:26.725505 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept: application/json Jul 28 04:04:26.725505 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept-Encoding: identity Jul 28 04:04:26.725505 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Connection: close Jul 28 04:04:26.725505 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Length: 0 Jul 28 04:04:26.725505 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Type: application/json Jul 28 04:04:26.725505 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Host: 10.222.0.46 Jul 28 04:04:26.725505 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Openstack-System-Scope: None Jul 28 04:04:26.725505 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: User-Agent: python-urllib3/1.26.10 Jul 28 04:04:26.725505 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Auth-Token: gAAAAABi4gmx9saU6X6wXaut0oV-DgXC4eOrOdUPDpTL-be51IOCob459Vnx3p8cEv5I-817MPvea-z5B1wjBZmkZVFZyS4Z5HE0xs4B5dv5vHGJrJ18ZwqUg2jQyx-xGnyCE7MhhFmKrX3UvKtRA53M9fiu3ycBzv2wFrj6Q7c0TYYzfm06pvY Jul 28 04:04:26.725505 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Id: None Jul 28 04:04:26.725505 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Name: None Jul 28 04:04:26.725505 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Identity-Status: Confirmed Jul 28 04:04:26.725505 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Is-Admin-Project: True Jul 28 04:04:26.725505 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Id: default Jul 28 04:04:26.725505 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Name: Default Jul 28 04:04:26.725505 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Id: 6ca5212b1a1743f2910407d7b8ba7aaf Jul 28 04:04:26.725505 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1523098003 Jul 28 04:04:26.725505 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Role: reader,member Jul 28 04:04:26.725505 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Roles: reader,member Jul 28 04:04:26.727119 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6ca5212b1a1743f2910407d7b8ba7aaf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ca5212b1a1743f2910407d7b8ba7aaf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ca5212b1a1743f2910407d7b8ba7aaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6ca5212b1a1743f2910407d7b8ba7aaf"}]}] Jul 28 04:04:26.727119 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1523098003 Jul 28 04:04:26.727119 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Id: 6ca5212b1a1743f2910407d7b8ba7aaf Jul 28 04:04:26.727119 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1523098003 Jul 28 04:04:26.727119 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User: tempest-ServerRescueNegativeTestJSON-1523098003-project Jul 28 04:04:26.727119 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Id: default Jul 28 04:04:26.727119 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Name: Default Jul 28 04:04:26.727119 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Id: 72dbbd19e4454bee84fe5bc797497bd0 Jul 28 04:04:26.727119 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1523098003-project Jul 28 04:04:26.727119 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: method: > Jul 28 04:04:26.727119 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: exception: Cannot 'detach_volume' instance fe24f923-0389-4154-a7bb-062800043d11 while it is in vm_state rescued Jul 28 04:04:26.727960 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: action_args: {'server_id': 'fe24f923-0389-4154-a7bb-062800043d11', 'id': 'f4ddd6fc-8893-41bd-927a-c256e0e3e7ee'} Jul 28 04:04:26.727960 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:04:26.727960 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:26.727960 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 28 04:04:26.727960 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 28 04:04:26.727960 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 04:04:26.727960 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 04:04:26.727960 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 146, in inner Jul 28 04:04:26.727960 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 28 04:04:26.727960 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance fe24f923-0389-4154-a7bb-062800043d11 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 28 04:04:26.727960 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:04:26.727960 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:04:26.727960 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:04:26.727960 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:26.727960 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:04:26.727960 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:04:26.727960 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:04:26.727960 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:04:26.727960 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:04:26.727960 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:04:26.729549 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 28 04:04:26.729549 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 28 04:04:26.729549 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 28 04:04:26.729549 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 28 04:04:26.729549 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance fe24f923-0389-4154-a7bb-062800043d11 while it is in vm_state rescued Jul 28 04:04:26.729549 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:04:26.729549 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:04:26.729549 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:04:26.729549 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:26.729549 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:04:26.729549 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:04:26.729549 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:04:26.729549 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:04:26.729549 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance fe24f923-0389-4154-a7bb-062800043d11 while it is in vm_state rescued Jul 28 04:04:26.729549 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:04:26.729549 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-f373c2b1-31cc-4ee1-9a0c-3a47acad9bdd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Returning 409 to user: Cannot 'detach_volume' instance fe24f923-0389-4154-a7bb-062800043d11 while it is in vm_state rescued {{(pid=118186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:04:26.730807 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-f373c2b1-31cc-4ee1-9a0c-3a47acad9bdd tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "DELETE /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11/os-volume_attachments/f4ddd6fc-8893-41bd-927a-c256e0e3e7ee" status: 409 len: 152 microversion: 2.1 time: 0.095741 Jul 28 04:04:26.730807 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 284/621] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Jul 28 04:04:26 2022] DELETE /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11/os-volume_attachments/f4ddd6fc-8893-41bd-927a-c256e0e3e7ee => generated 152 bytes in 97 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 28 04:04:26.735801 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3dd32fe4-b369-4cce-aea1-103fbe0ee811 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:26.737092 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3dd32fe4-b369-4cce-aea1-103fbe0ee811 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:26.743043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3dd32fe4-b369-4cce-aea1-103fbe0ee811 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:26.743492 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3dd32fe4-b369-4cce-aea1-103fbe0ee811 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:26.744246 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3dd32fe4-b369-4cce-aea1-103fbe0ee811 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:26.744676 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3dd32fe4-b369-4cce-aea1-103fbe0ee811 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:26.791797 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:26.811334 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3dd32fe4-b369-4cce-aea1-103fbe0ee811 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "POST /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11/action" status: 202 len: 0 microversion: 2.1 time: 0.079132 Jul 28 04:04:26.812164 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 338/622] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Jul 28 04:04:26 2022] POST /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11/action => generated 0 bytes in 81 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:04:26.820538 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-66d99570-2c03-4a0c-8fb9-6338b548757a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:26.821083 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-66d99570-2c03-4a0c-8fb9-6338b548757a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:26.828126 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-66d99570-2c03-4a0c-8fb9-6338b548757a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:26.828655 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-66d99570-2c03-4a0c-8fb9-6338b548757a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:26.829443 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-66d99570-2c03-4a0c-8fb9-6338b548757a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:26.830631 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-66d99570-2c03-4a0c-8fb9-6338b548757a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:27.054808 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-66d99570-2c03-4a0c-8fb9-6338b548757a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:27.062743 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-66d99570-2c03-4a0c-8fb9-6338b548757a tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1724 microversion: 2.1 time: 0.246076 Jul 28 04:04:27.063360 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 285/623] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:26 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:04:28.085579 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-bb56e2dd-0f52-4e80-8a16-9e5355be7319 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:28.086279 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-bb56e2dd-0f52-4e80-8a16-9e5355be7319 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:28.092962 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bb56e2dd-0f52-4e80-8a16-9e5355be7319 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:28.093413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bb56e2dd-0f52-4e80-8a16-9e5355be7319 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:28.094174 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bb56e2dd-0f52-4e80-8a16-9e5355be7319 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:28.094613 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bb56e2dd-0f52-4e80-8a16-9e5355be7319 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:28.227082 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-bb56e2dd-0f52-4e80-8a16-9e5355be7319 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:28.235033 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-bb56e2dd-0f52-4e80-8a16-9e5355be7319 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1724 microversion: 2.1 time: 0.153652 Jul 28 04:04:28.235602 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 339/624] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:28 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:29.256693 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-7f016393-445b-4794-8634-c4649f7ae023 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:29.257295 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-7f016393-445b-4794-8634-c4649f7ae023 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:29.263767 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7f016393-445b-4794-8634-c4649f7ae023 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:29.264217 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7f016393-445b-4794-8634-c4649f7ae023 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:29.264959 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7f016393-445b-4794-8634-c4649f7ae023 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:29.265387 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7f016393-445b-4794-8634-c4649f7ae023 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:29.551732 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-7f016393-445b-4794-8634-c4649f7ae023 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:29.559957 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-7f016393-445b-4794-8634-c4649f7ae023 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1724 microversion: 2.1 time: 0.307223 Jul 28 04:04:29.560526 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 286/625] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:29 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:30.581502 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a7299d39-2385-49bb-ae66-b7c0a3902215 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:30.582121 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a7299d39-2385-49bb-ae66-b7c0a3902215 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:30.588715 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7299d39-2385-49bb-ae66-b7c0a3902215 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:30.589169 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7299d39-2385-49bb-ae66-b7c0a3902215 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:30.589927 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7299d39-2385-49bb-ae66-b7c0a3902215 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:30.590363 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7299d39-2385-49bb-ae66-b7c0a3902215 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:30.716820 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a7299d39-2385-49bb-ae66-b7c0a3902215 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:30.725317 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a7299d39-2385-49bb-ae66-b7c0a3902215 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1730 microversion: 2.1 time: 0.148540 Jul 28 04:04:30.725882 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 340/626] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:30 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1730 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:30.745427 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-3f51d661-70b4-4d70-a83c-bd2d6958e61e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:30.745933 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-3f51d661-70b4-4d70-a83c-bd2d6958e61e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:30.753053 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3f51d661-70b4-4d70-a83c-bd2d6958e61e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:30.753499 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3f51d661-70b4-4d70-a83c-bd2d6958e61e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:30.754269 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3f51d661-70b4-4d70-a83c-bd2d6958e61e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:30.754702 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3f51d661-70b4-4d70-a83c-bd2d6958e61e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:30.837408 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-3f51d661-70b4-4d70-a83c-bd2d6958e61e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095717 Jul 28 04:04:30.838015 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 287/627] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Jul 28 04:04:30 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11/os-interface => generated 285 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:31.717768 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-9422cf59-cfd6-4b24-a09d-f6c17e945661 req-2dc75554-2798-4023-be67-741450a02dfa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe24f923-0389-4154-a7bb-062800043d11", "tag": "606d30e1-9cda-4404-8c90-b1f1e3b45f28"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:31.728969 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-9422cf59-cfd6-4b24-a09d-f6c17e945661 req-2dc75554-2798-4023-be67-741450a02dfa service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:31.729414 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-9422cf59-cfd6-4b24-a09d-f6c17e945661 req-2dc75554-2798-4023-be67-741450a02dfa service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:31.741123 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-9422cf59-cfd6-4b24-a09d-f6c17e945661 req-2dc75554-2798-4023-be67-741450a02dfa service nova] Creating event network-changed:606d30e1-9cda-4404-8c90-b1f1e3b45f28 for instance fe24f923-0389-4154-a7bb-062800043d11 on hv-cinder-79987 Jul 28 04:04:31.746060 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-9422cf59-cfd6-4b24-a09d-f6c17e945661 req-2dc75554-2798-4023-be67-741450a02dfa service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032011 Jul 28 04:04:31.746810 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 341/628] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:04:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:33.760985 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-b131bed9-00ba-48f7-a235-115e607b9edd req-1cbb0ed0-c7af-4fbd-abec-01bba43d3394 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe24f923-0389-4154-a7bb-062800043d11", "tag": "606d30e1-9cda-4404-8c90-b1f1e3b45f28"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:33.770549 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-b131bed9-00ba-48f7-a235-115e607b9edd req-1cbb0ed0-c7af-4fbd-abec-01bba43d3394 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:33.771023 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-b131bed9-00ba-48f7-a235-115e607b9edd req-1cbb0ed0-c7af-4fbd-abec-01bba43d3394 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:33.781774 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-b131bed9-00ba-48f7-a235-115e607b9edd req-1cbb0ed0-c7af-4fbd-abec-01bba43d3394 service nova] Creating event network-changed:606d30e1-9cda-4404-8c90-b1f1e3b45f28 for instance fe24f923-0389-4154-a7bb-062800043d11 on hv-cinder-79987 Jul 28 04:04:33.787748 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-b131bed9-00ba-48f7-a235-115e607b9edd req-1cbb0ed0-c7af-4fbd-abec-01bba43d3394 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030930 Jul 28 04:04:33.788393 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 288/629] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:04:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:48.624860 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=17 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:48.625599 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=15,nova_cell1:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:48.631123 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-db42c3ba-c6a5-4873-bd61-83374c44407b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:48.633338 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-db42c3ba-c6a5-4873-bd61-83374c44407b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:48.640741 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-db42c3ba-c6a5-4873-bd61-83374c44407b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:48.641196 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-db42c3ba-c6a5-4873-bd61-83374c44407b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:48.641958 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-db42c3ba-c6a5-4873-bd61-83374c44407b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:48.643019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-db42c3ba-c6a5-4873-bd61-83374c44407b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:48.671013 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-db42c3ba-c6a5-4873-bd61-83374c44407b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047607 Jul 28 04:04:48.671556 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 342/630] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Jul 28 04:04:48 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:04:48.731258 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=11 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:48.732134 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=38 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:04:48.736720 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c5c851e1-483a-4fb3-a8b1-342b21d6ec01 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:48.737301 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c5c851e1-483a-4fb3-a8b1-342b21d6ec01 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:48.744363 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c5c851e1-483a-4fb3-a8b1-342b21d6ec01 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:48.744817 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c5c851e1-483a-4fb3-a8b1-342b21d6ec01 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:48.745582 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c5c851e1-483a-4fb3-a8b1-342b21d6ec01 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:48.746037 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c5c851e1-483a-4fb3-a8b1-342b21d6ec01 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:48.770802 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c5c851e1-483a-4fb3-a8b1-342b21d6ec01 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Going to try to terminate instance {{(pid=118186) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:04:48.844071 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-c5c851e1-483a-4fb3-a8b1-342b21d6ec01 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "DELETE /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 204 len: 0 microversion: 2.1 time: 0.114133 Jul 28 04:04:48.844653 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 289/631] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:04:48 2022] DELETE /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:04:48.854568 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-38b0043f-4802-4e1c-ab99-4a98f2ea5e27 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:48.855219 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-38b0043f-4802-4e1c-ab99-4a98f2ea5e27 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:48.861776 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-38b0043f-4802-4e1c-ab99-4a98f2ea5e27 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:48.862226 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-38b0043f-4802-4e1c-ab99-4a98f2ea5e27 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:48.863014 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-38b0043f-4802-4e1c-ab99-4a98f2ea5e27 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:48.863454 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-38b0043f-4802-4e1c-ab99-4a98f2ea5e27 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:49.043814 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-38b0043f-4802-4e1c-ab99-4a98f2ea5e27 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:49.052313 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-38b0043f-4802-4e1c-ab99-4a98f2ea5e27 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1672 microversion: 2.1 time: 0.201972 Jul 28 04:04:49.052877 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 343/632] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:48 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1672 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:50.076645 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-83b75f36-6918-404a-9812-12b85073946f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:50.077348 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-83b75f36-6918-404a-9812-12b85073946f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:50.084944 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-83b75f36-6918-404a-9812-12b85073946f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:50.085396 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-83b75f36-6918-404a-9812-12b85073946f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:50.086157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-83b75f36-6918-404a-9812-12b85073946f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:50.086594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-83b75f36-6918-404a-9812-12b85073946f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:50.221124 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-83b75f36-6918-404a-9812-12b85073946f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:50.228628 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-83b75f36-6918-404a-9812-12b85073946f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1672 microversion: 2.1 time: 0.156316 Jul 28 04:04:50.229192 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 290/633] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:50 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:51.251140 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ab08af85-802e-405b-a55a-6f452f9e7906 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:51.252478 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ab08af85-802e-405b-a55a-6f452f9e7906 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:51.259248 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ab08af85-802e-405b-a55a-6f452f9e7906 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:51.259706 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ab08af85-802e-405b-a55a-6f452f9e7906 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:51.260487 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ab08af85-802e-405b-a55a-6f452f9e7906 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:51.260912 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ab08af85-802e-405b-a55a-6f452f9e7906 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:51.397203 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ab08af85-802e-405b-a55a-6f452f9e7906 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:51.404739 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ab08af85-802e-405b-a55a-6f452f9e7906 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1672 microversion: 2.1 time: 0.157539 Jul 28 04:04:51.405311 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 344/634] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:51 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:52.202130 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-b21bff68-80b1-4856-baf4-dada1282bc15 req-a53ec5f2-283c-4d87-9f78-f315e4ed45f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "beb705c5-be1c-471d-82d9-b6d699ead475", "name": "network-vif-deleted", "tag": "bcfe84f6-7f7b-4876-8b26-9916056e7600"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:52.219500 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-b21bff68-80b1-4856-baf4-dada1282bc15 req-a53ec5f2-283c-4d87-9f78-f315e4ed45f4 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:52.220918 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-b21bff68-80b1-4856-baf4-dada1282bc15 req-a53ec5f2-283c-4d87-9f78-f315e4ed45f4 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:52.242894 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-b21bff68-80b1-4856-baf4-dada1282bc15 req-a53ec5f2-283c-4d87-9f78-f315e4ed45f4 service nova] Creating event network-vif-deleted:bcfe84f6-7f7b-4876-8b26-9916056e7600 for instance beb705c5-be1c-471d-82d9-b6d699ead475 on hv-cinder-79987 Jul 28 04:04:52.250594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-b21bff68-80b1-4856-baf4-dada1282bc15 req-a53ec5f2-283c-4d87-9f78-f315e4ed45f4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051915 Jul 28 04:04:52.252785 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 291/635] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:52.427739 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6ac9ba14-c8a4-4d99-8e69-4b4f9ee5e390 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:52.429168 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6ac9ba14-c8a4-4d99-8e69-4b4f9ee5e390 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:52.435845 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6ac9ba14-c8a4-4d99-8e69-4b4f9ee5e390 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:52.436298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6ac9ba14-c8a4-4d99-8e69-4b4f9ee5e390 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:52.437065 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6ac9ba14-c8a4-4d99-8e69-4b4f9ee5e390 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:52.437534 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6ac9ba14-c8a4-4d99-8e69-4b4f9ee5e390 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:52.472029 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6ac9ba14-c8a4-4d99-8e69-4b4f9ee5e390 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:52.472486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6ac9ba14-c8a4-4d99-8e69-4b4f9ee5e390 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:52.472955 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.objects.instance [None req-6ac9ba14-c8a4-4d99-8e69-4b4f9ee5e390 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lazy-loading 'fault' on Instance uuid beb705c5-be1c-471d-82d9-b6d699ead475 {{(pid=118187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:04:52.514107 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6ac9ba14-c8a4-4d99-8e69-4b4f9ee5e390 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:52.521706 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6ac9ba14-c8a4-4d99-8e69-4b4f9ee5e390 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 200 len: 1325 microversion: 2.1 time: 0.098636 Jul 28 04:04:52.522277 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 345/636] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:52 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 1325 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:53.543778 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-4ab12ca5-a29b-4a84-88f8-e453e7840522 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:53.544475 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-4ab12ca5-a29b-4a84-88f8-e453e7840522 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:53.551479 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4ab12ca5-a29b-4a84-88f8-e453e7840522 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:53.551925 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4ab12ca5-a29b-4a84-88f8-e453e7840522 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:53.552683 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4ab12ca5-a29b-4a84-88f8-e453e7840522 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:53.553117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4ab12ca5-a29b-4a84-88f8-e453e7840522 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:53.566837 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.wsgi [None req-4ab12ca5-a29b-4a84-88f8-e453e7840522 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] HTTP exception thrown: Instance beb705c5-be1c-471d-82d9-b6d699ead475 could not be found. Jul 28 04:04:53.568765 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-4ab12ca5-a29b-4a84-88f8-e453e7840522 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Request method failure captured: Jul 28 04:04:53.568765 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: request: GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 HTTP/1.1 Jul 28 04:04:53.568765 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept: application/json Jul 28 04:04:53.568765 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept-Encoding: identity Jul 28 04:04:53.568765 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Connection: close Jul 28 04:04:53.568765 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Length: 0 Jul 28 04:04:53.568765 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Type: application/json Jul 28 04:04:53.568765 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Host: 10.222.0.46 Jul 28 04:04:53.568765 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Openstack-System-Scope: None Jul 28 04:04:53.568765 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: User-Agent: python-urllib3/1.26.10 Jul 28 04:04:53.568765 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Auth-Token: gAAAAABi4gmvBMnfb8DTsIkgUa4MflJw_khZbOOklb3o8cTO1OBAYvtXeo1m8PBQrIox6r8bSG9QniIJnr_VCAM_w9OH-_z8cUBrcSv_yuSahr6_6JdG10-UT9QXWIA4LQaualsr4hMi4wp8NV2iLgQWCinAWb8VHl11UjNolYlN6vUa5fspesg Jul 28 04:04:53.568765 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Id: None Jul 28 04:04:53.568765 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Name: None Jul 28 04:04:53.568765 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Identity-Status: Confirmed Jul 28 04:04:53.568765 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Is-Admin-Project: True Jul 28 04:04:53.568765 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Id: default Jul 28 04:04:53.568765 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Name: Default Jul 28 04:04:53.568765 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Id: 5db0f08a14ac472fb3edf2107c9ccfc5 Jul 28 04:04:53.568765 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Name: tempest-AttachVolumeTestJSON-403862681 Jul 28 04:04:53.568765 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Role: reader,member Jul 28 04:04:53.568765 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Roles: reader,member Jul 28 04:04:53.570139 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5db0f08a14ac472fb3edf2107c9ccfc5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5db0f08a14ac472fb3edf2107c9ccfc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5db0f08a14ac472fb3edf2107c9ccfc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5db0f08a14ac472fb3edf2107c9ccfc5"}]}] Jul 28 04:04:53.570139 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant: tempest-AttachVolumeTestJSON-403862681 Jul 28 04:04:53.570139 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Id: 5db0f08a14ac472fb3edf2107c9ccfc5 Jul 28 04:04:53.570139 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Name: tempest-AttachVolumeTestJSON-403862681 Jul 28 04:04:53.570139 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User: tempest-AttachVolumeTestJSON-403862681-project Jul 28 04:04:53.570139 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Id: default Jul 28 04:04:53.570139 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Name: Default Jul 28 04:04:53.570139 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Id: 7112379fb6794027a7c1519b2f77a5d4 Jul 28 04:04:53.570139 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Name: tempest-AttachVolumeTestJSON-403862681-project Jul 28 04:04:53.570139 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: method: > Jul 28 04:04:53.570139 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: exception: Instance beb705c5-be1c-471d-82d9-b6d699ead475 could not be found. Jul 28 04:04:53.570139 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: action_args: {'id': 'beb705c5-be1c-471d-82d9-b6d699ead475'} Jul 28 04:04:53.570979 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:04:53.570979 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:53.570979 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:04:53.570979 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:04:53.570979 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:04:53.570979 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:04:53.570979 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:04:53.570979 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:04:53.570979 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:04:53.570979 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:04:53.570979 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beb705c5-be1c-471d-82d9-b6d699ead475 could not be found. Jul 28 04:04:53.570979 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:04:53.570979 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:04:53.570979 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:04:53.570979 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:53.570979 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:04:53.570979 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:04:53.570979 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:04:53.570979 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:04:53.570979 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:04:53.572547 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:04:53.572547 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:04:53.572547 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:04:53.572547 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:04:53.572547 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:04:53.572547 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:04:53.572547 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:04:53.572547 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beb705c5-be1c-471d-82d9-b6d699ead475 could not be found. Jul 28 04:04:53.572547 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:04:53.572547 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:04:53.572547 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:04:53.572547 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:04:53.572547 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:04:53.572547 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:04:53.572547 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:04:53.572547 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:04:53.572547 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beb705c5-be1c-471d-82d9-b6d699ead475 could not be found. Jul 28 04:04:53.572547 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:04:53.573887 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-4ab12ca5-a29b-4a84-88f8-e453e7840522 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Returning 404 to user: Instance beb705c5-be1c-471d-82d9-b6d699ead475 could not be found. {{(pid=118186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:04:53.573887 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-4ab12ca5-a29b-4a84-88f8-e453e7840522 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 404 len: 111 microversion: 2.1 time: 0.030818 Jul 28 04:04:53.573887 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 292/637] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:53 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:04:53.579250 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-67d9b5b0-b938-432a-a8cd-3e7c71cbbd52 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '.version_select at 0x7fa6ee0425e0>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:53.598855 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-67d9b5b0-b938-432a-a8cd-3e7c71cbbd52 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-852713893" status: 202 len: 0 microversion: 2.1 time: 0.023357 Jul 28 04:04:53.599411 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 346/638] 10.222.0.46 () {58 vars in 1218 bytes} [Thu Jul 28 04:04:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-852713893 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:04:54.229726 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c771836c-1842-4766-be81-5cc80d3560ba tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Action: 'create', calling method: .version_select at 0x7fa6ee0a04c0>, body: {"keypair": {"name": "tempest-keypair-1843428183", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIRQWv+MkCqzOHeU9GDIP8wJjYByQ6YxOhBJ9j9PVQrV3Xb/vYDeqWs20pqUuhjNh4iSaxSI5F+Y/Zmp8xAVduwIzREqyGB9McvF62hG2BcmbGnJWZx+yM+9PayehJdVdA=="}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:54.244901 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-c771836c-1842-4766-be81-5cc80d3560ba tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Getting quotas for project 5db0f08a14ac472fb3edf2107c9ccfc5. Resources: {'key_pairs'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:04:54.248757 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-c771836c-1842-4766-be81-5cc80d3560ba tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Getting quotas for user 7112379fb6794027a7c1519b2f77a5d4 and project 5db0f08a14ac472fb3edf2107c9ccfc5. Resources: {'key_pairs'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:04:54.273428 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-c771836c-1842-4766-be81-5cc80d3560ba tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.047646 Jul 28 04:04:54.274035 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 293/639] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 04:04:54 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:55.502619 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b3f90666-a7ca-4116-83b6-23de8b89231e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-878646128", "imageRef": "a0eec51c-83e9-420b-bcb9-20fe8dcf5321", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ddbc06c5-f1b9-4080-a226-5763d344d779"}], "security_groups": [{"name": "tempest-securitygroup--726338796"}], "key_name": "tempest-keypair-1843428183", "user_data": "}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:55.606823 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.network.neutron [None req-b3f90666-a7ca-4116-83b6-23de8b89231e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] validate_networks() for [('ddbc06c5-f1b9-4080-a226-5763d344d779', None, None, None, None, None)] {{(pid=118187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:04:56.006968 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-b3f90666-a7ca-4116-83b6-23de8b89231e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Flavor limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:04:56.007431 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-b3f90666-a7ca-4116-83b6-23de8b89231e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Image limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:04:56.007919 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-b3f90666-a7ca-4116-83b6-23de8b89231e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Flavor pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:04:56.008365 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-b3f90666-a7ca-4116-83b6-23de8b89231e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Image pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:04:56.008780 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-b3f90666-a7ca-4116-83b6-23de8b89231e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:04:56.017977 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b3f90666-a7ca-4116-83b6-23de8b89231e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:56.019102 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b3f90666-a7ca-4116-83b6-23de8b89231e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:56.019915 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b3f90666-a7ca-4116-83b6-23de8b89231e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:56.020349 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b3f90666-a7ca-4116-83b6-23de8b89231e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:56.036419 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-b3f90666-a7ca-4116-83b6-23de8b89231e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Getting quotas for project 5db0f08a14ac472fb3edf2107c9ccfc5. Resources: {'instances', 'cores', 'ram'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:04:56.040554 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-b3f90666-a7ca-4116-83b6-23de8b89231e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Getting quotas for user 7112379fb6794027a7c1519b2f77a5d4 and project 5db0f08a14ac472fb3edf2107c9ccfc5. Resources: {'instances', 'cores', 'ram'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:04:56.051457 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b3f90666-a7ca-4116-83b6-23de8b89231e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Going to run 1 instances... {{(pid=118187) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:04:56.053666 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b3f90666-a7ca-4116-83b6-23de8b89231e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0eec51c-83e9-420b-bcb9-20fe8dcf5321',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:04:56.101892 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b3f90666-a7ca-4116-83b6-23de8b89231e tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.603718 Jul 28 04:04:56.102552 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 347/640] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 04:04:55 2022] POST /compute/v2.1/servers => generated 401 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 28 04:04:56.113519 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-b10ee08d-3d10-4296-bb0f-f5873d0d14a0 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:56.114141 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-b10ee08d-3d10-4296-bb0f-f5873d0d14a0 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:56.171004 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-b10ee08d-3d10-4296-bb0f-f5873d0d14a0 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:56.178252 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-b10ee08d-3d10-4296-bb0f-f5873d0d14a0 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53" status: 200 len: 1237 microversion: 2.1 time: 0.068632 Jul 28 04:04:56.178867 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 294/641] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:56 2022] GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53 => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:57.199512 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e930a2cb-69a0-4e15-a02d-556738a0a15b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:57.200318 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e930a2cb-69a0-4e15-a02d-556738a0a15b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:57.207594 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e930a2cb-69a0-4e15-a02d-556738a0a15b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:57.208050 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e930a2cb-69a0-4e15-a02d-556738a0a15b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:57.208826 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e930a2cb-69a0-4e15-a02d-556738a0a15b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:57.209258 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e930a2cb-69a0-4e15-a02d-556738a0a15b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:57.275358 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e930a2cb-69a0-4e15-a02d-556738a0a15b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:57.282804 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e930a2cb-69a0-4e15-a02d-556738a0a15b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53" status: 200 len: 1307 microversion: 2.1 time: 0.088091 Jul 28 04:04:57.289720 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 348/642] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:57 2022] GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53 => generated 1307 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:58.304759 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-938239b8-e563-4d10-aa62-d4e264dba216 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:58.305204 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-938239b8-e563-4d10-aa62-d4e264dba216 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:58.311501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-938239b8-e563-4d10-aa62-d4e264dba216 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:58.312023 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-938239b8-e563-4d10-aa62-d4e264dba216 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:58.312804 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-938239b8-e563-4d10-aa62-d4e264dba216 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:58.313236 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-938239b8-e563-4d10-aa62-d4e264dba216 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:58.547865 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-938239b8-e563-4d10-aa62-d4e264dba216 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:58.556636 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-938239b8-e563-4d10-aa62-d4e264dba216 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53" status: 200 len: 1362 microversion: 2.1 time: 0.255951 Jul 28 04:04:58.557157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 295/643] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:58 2022] GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53 => generated 1362 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:04:58.675917 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-c1982524-dc7b-4539-9c9f-4ef9ce8467ad req-d52f9192-d5dc-4514-84f3-b5107751e320 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba939cf-1f23-4c51-9726-de6bc52c5a53", "tag": "971f1529-be5d-4544-a99f-c6a4b11153dd"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:04:58.692472 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-c1982524-dc7b-4539-9c9f-4ef9ce8467ad req-d52f9192-d5dc-4514-84f3-b5107751e320 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:58.693203 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-c1982524-dc7b-4539-9c9f-4ef9ce8467ad req-d52f9192-d5dc-4514-84f3-b5107751e320 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:58.716856 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-c1982524-dc7b-4539-9c9f-4ef9ce8467ad req-d52f9192-d5dc-4514-84f3-b5107751e320 service nova] Creating event network-changed:971f1529-be5d-4544-a99f-c6a4b11153dd for instance 5ba939cf-1f23-4c51-9726-de6bc52c5a53 on hv-cinder-79987 Jul 28 04:04:58.723263 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-c1982524-dc7b-4539-9c9f-4ef9ce8467ad req-d52f9192-d5dc-4514-84f3-b5107751e320 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051764 Jul 28 04:04:58.724468 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 349/644] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:59.153594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-5625e413-393c-40e9-9d7b-3849d25d2f55 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:59.154098 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-5625e413-393c-40e9-9d7b-3849d25d2f55 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:59.160502 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5625e413-393c-40e9-9d7b-3849d25d2f55 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:59.160971 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5625e413-393c-40e9-9d7b-3849d25d2f55 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:59.162016 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5625e413-393c-40e9-9d7b-3849d25d2f55 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:59.162460 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5625e413-393c-40e9-9d7b-3849d25d2f55 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:59.186463 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-5625e413-393c-40e9-9d7b-3849d25d2f55 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7/ips" status: 200 len: 150 microversion: 2.1 time: 0.092552 Jul 28 04:04:59.187057 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 296/645] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Jul 28 04:04:59 2022] GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7/ips => generated 150 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:04:59.578060 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6896cb56-b397-444d-bee3-9fb0cd241150 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:04:59.578756 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6896cb56-b397-444d-bee3-9fb0cd241150 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:04:59.585600 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6896cb56-b397-444d-bee3-9fb0cd241150 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:59.586048 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6896cb56-b397-444d-bee3-9fb0cd241150 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:59.586820 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6896cb56-b397-444d-bee3-9fb0cd241150 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:04:59.587327 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6896cb56-b397-444d-bee3-9fb0cd241150 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:04:59.711905 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6896cb56-b397-444d-bee3-9fb0cd241150 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:04:59.719262 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6896cb56-b397-444d-bee3-9fb0cd241150 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53" status: 200 len: 1362 microversion: 2.1 time: 0.145459 Jul 28 04:04:59.719822 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 350/646] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:04:59 2022] GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53 => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:00.511530 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-1159abf3-9536-4900-8caf-3ed88d73cd67 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bfd998d1-f8ff-4163-9fb1-fa513f8153e0"}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:00.513929 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-1159abf3-9536-4900-8caf-3ed88d73cd67 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:00.520628 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1159abf3-9536-4900-8caf-3ed88d73cd67 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:00.521133 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1159abf3-9536-4900-8caf-3ed88d73cd67 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:00.521900 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1159abf3-9536-4900-8caf-3ed88d73cd67 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:00.522333 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1159abf3-9536-4900-8caf-3ed88d73cd67 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:00.741963 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4370877d-bc3a-456a-81eb-be3b4ac47de6 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:00.742590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-4370877d-bc3a-456a-81eb-be3b4ac47de6 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:00.749108 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4370877d-bc3a-456a-81eb-be3b4ac47de6 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:00.749555 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4370877d-bc3a-456a-81eb-be3b4ac47de6 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:00.750328 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4370877d-bc3a-456a-81eb-be3b4ac47de6 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:00.750817 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4370877d-bc3a-456a-81eb-be3b4ac47de6 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:00.763563 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-1159abf3-9536-4900-8caf-3ed88d73cd67 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "POST /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.255743 Jul 28 04:05:00.764204 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 297/647] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Jul 28 04:05:00 2022] POST /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7/os-volume_attachments => generated 194 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:00.890329 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4370877d-bc3a-456a-81eb-be3b4ac47de6 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:00.898822 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4370877d-bc3a-456a-81eb-be3b4ac47de6 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53" status: 200 len: 1362 microversion: 2.1 time: 0.160873 Jul 28 04:05:00.899458 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 351/648] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:00 2022] GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:01.920993 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-383232c3-76a0-41df-8bf9-4e5c465c2487 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:01.921803 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-383232c3-76a0-41df-8bf9-4e5c465c2487 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:01.929391 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-383232c3-76a0-41df-8bf9-4e5c465c2487 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:01.929842 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-383232c3-76a0-41df-8bf9-4e5c465c2487 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:01.930632 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-383232c3-76a0-41df-8bf9-4e5c465c2487 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:01.931226 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-383232c3-76a0-41df-8bf9-4e5c465c2487 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:02.071710 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-383232c3-76a0-41df-8bf9-4e5c465c2487 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:02.079149 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-383232c3-76a0-41df-8bf9-4e5c465c2487 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53" status: 200 len: 1362 microversion: 2.1 time: 0.162426 Jul 28 04:05:02.079719 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 298/649] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:01 2022] GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53 => generated 1362 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:03.099853 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d95e8806-5afe-4a00-ab91-b44b840b5eaf tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:03.100476 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d95e8806-5afe-4a00-ab91-b44b840b5eaf tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:03.107107 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d95e8806-5afe-4a00-ab91-b44b840b5eaf tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:03.107559 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d95e8806-5afe-4a00-ab91-b44b840b5eaf tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:03.108329 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d95e8806-5afe-4a00-ab91-b44b840b5eaf tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:03.108771 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d95e8806-5afe-4a00-ab91-b44b840b5eaf tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:03.234251 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d95e8806-5afe-4a00-ab91-b44b840b5eaf tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:03.242152 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d95e8806-5afe-4a00-ab91-b44b840b5eaf tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53" status: 200 len: 1362 microversion: 2.1 time: 0.146489 Jul 28 04:05:03.242716 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 352/650] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:03 2022] GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53 => generated 1362 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:03.618663 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-d0f48f6e-58e2-40ea-9d44-c32a69516b5c req-599762dc-13be-462b-908f-3b6043d3d4c7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba939cf-1f23-4c51-9726-de6bc52c5a53", "name": "network-vif-plugged", "status": "completed", "tag": "971f1529-be5d-4544-a99f-c6a4b11153dd"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:03.630810 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-d0f48f6e-58e2-40ea-9d44-c32a69516b5c req-599762dc-13be-462b-908f-3b6043d3d4c7 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:03.631347 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-d0f48f6e-58e2-40ea-9d44-c32a69516b5c req-599762dc-13be-462b-908f-3b6043d3d4c7 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:03.644382 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-d0f48f6e-58e2-40ea-9d44-c32a69516b5c req-599762dc-13be-462b-908f-3b6043d3d4c7 service nova] Creating event network-vif-plugged:971f1529-be5d-4544-a99f-c6a4b11153dd for instance 5ba939cf-1f23-4c51-9726-de6bc52c5a53 on hv-cinder-79987 Jul 28 04:05:03.649372 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-d0f48f6e-58e2-40ea-9d44-c32a69516b5c req-599762dc-13be-462b-908f-3b6043d3d4c7 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034756 Jul 28 04:05:03.650450 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 299/651] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:04.263232 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-dc3507f5-2c7a-46a3-95a1-547b09176ec8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:04.263791 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-dc3507f5-2c7a-46a3-95a1-547b09176ec8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:04.271429 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dc3507f5-2c7a-46a3-95a1-547b09176ec8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:04.271877 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dc3507f5-2c7a-46a3-95a1-547b09176ec8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:04.272639 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dc3507f5-2c7a-46a3-95a1-547b09176ec8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:04.273078 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dc3507f5-2c7a-46a3-95a1-547b09176ec8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:04.406597 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-dc3507f5-2c7a-46a3-95a1-547b09176ec8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:04.414603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-dc3507f5-2c7a-46a3-95a1-547b09176ec8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53" status: 200 len: 1362 microversion: 2.1 time: 0.155256 Jul 28 04:05:04.415221 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 353/652] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:04 2022] GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:05.435936 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-04f4527e-8768-4eef-81d4-584b8626ebba tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:05.436708 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-04f4527e-8768-4eef-81d4-584b8626ebba tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:05.444668 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-04f4527e-8768-4eef-81d4-584b8626ebba tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:05.445146 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-04f4527e-8768-4eef-81d4-584b8626ebba tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:05.445919 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-04f4527e-8768-4eef-81d4-584b8626ebba tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:05.446356 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-04f4527e-8768-4eef-81d4-584b8626ebba tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:05.580420 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-04f4527e-8768-4eef-81d4-584b8626ebba tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:05.588053 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-04f4527e-8768-4eef-81d4-584b8626ebba tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53" status: 200 len: 1548 microversion: 2.1 time: 0.156380 Jul 28 04:05:05.588621 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 300/653] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:05 2022] GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:05.608629 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-71edcc80-71ad-4fa7-b1a9-3058fecbbb86 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:05.609139 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-71edcc80-71ad-4fa7-b1a9-3058fecbbb86 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:05.616727 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-71edcc80-71ad-4fa7-b1a9-3058fecbbb86 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:05.617177 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-71edcc80-71ad-4fa7-b1a9-3058fecbbb86 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:05.617935 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-71edcc80-71ad-4fa7-b1a9-3058fecbbb86 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:05.618367 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-71edcc80-71ad-4fa7-b1a9-3058fecbbb86 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:05.694567 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-71edcc80-71ad-4fa7-b1a9-3058fecbbb86 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089650 Jul 28 04:05:05.695251 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 354/654] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Jul 28 04:05:05 2022] GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:06.882920 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell0:SELECT=6 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:06.941417 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-03f5f55e-c81d-4d61-b16b-81f97b9df66a req-f88952a2-9057-4303-b178-520c6935a6fb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba939cf-1f23-4c51-9726-de6bc52c5a53", "tag": "971f1529-be5d-4544-a99f-c6a4b11153dd"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:06.950758 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-03f5f55e-c81d-4d61-b16b-81f97b9df66a req-f88952a2-9057-4303-b178-520c6935a6fb service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:06.951480 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-03f5f55e-c81d-4d61-b16b-81f97b9df66a req-f88952a2-9057-4303-b178-520c6935a6fb service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:06.963179 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-03f5f55e-c81d-4d61-b16b-81f97b9df66a req-f88952a2-9057-4303-b178-520c6935a6fb service nova] Creating event network-changed:971f1529-be5d-4544-a99f-c6a4b11153dd for instance 5ba939cf-1f23-4c51-9726-de6bc52c5a53 on hv-cinder-79987 Jul 28 04:05:06.968196 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-03f5f55e-c81d-4d61-b16b-81f97b9df66a req-f88952a2-9057-4303-b178-520c6935a6fb service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090624 Jul 28 04:05:06.968788 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 301/655] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:08.286400 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:08.287457 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=6 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:08.292642 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d005c5ce-5a7a-4328-83bd-6472549c1196 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bfd998d1-f8ff-4163-9fb1-fa513f8153e0"}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:08.295057 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d005c5ce-5a7a-4328-83bd-6472549c1196 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:08.302716 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d005c5ce-5a7a-4328-83bd-6472549c1196 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:08.303191 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d005c5ce-5a7a-4328-83bd-6472549c1196 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:08.303955 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d005c5ce-5a7a-4328-83bd-6472549c1196 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:08.304394 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d005c5ce-5a7a-4328-83bd-6472549c1196 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:08.384007 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-d005c5ce-5a7a-4328-83bd-6472549c1196 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] HTTP exception thrown: Invalid volume: volume bfd998d1-f8ff-4163-9fb1-fa513f8153e0 is already attached to instances: 317bde19-5d15-4691-b014-3e2d001184e7 Jul 28 04:05:08.385734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d005c5ce-5a7a-4328-83bd-6472549c1196 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Request method failure captured: Jul 28 04:05:08.385734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: POST /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7/os-volume_attachments HTTP/1.1 Jul 28 04:05:08.385734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:05:08.385734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:05:08.385734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:05:08.385734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 74 Jul 28 04:05:08.385734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:05:08.385734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:05:08.385734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:05:08.385734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:05:08.385734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gmoXQtNoyNZeVOBtHeH0p0IZl6gLmXu7uMplYaqMcIU3TXk6NAztCb7-3xvXPbqffriel8JQiqKAHgD2FYfvE1RoXCiUMTvpIZjixGVtBiBXhQr6lOIK0tmH4bMvCgHENHbbkhJpWpz1XJYt5CJBH3JqJi5ypO8pp_YsE0VFSnKOUI Jul 28 04:05:08.385734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:05:08.385734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:05:08.385734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:05:08.385734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:05:08.385734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:05:08.385734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:05:08.385734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:05:08.385734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:05:08.385734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:05:08.385734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:05:08.387275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_18a927e9f5da42d7b34752c8b2db211a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/18a927e9f5da42d7b34752c8b2db211a"}]}] Jul 28 04:05:08.387275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:05:08.387275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:05:08.387275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:05:08.387275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:05:08.387275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:05:08.387275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:05:08.387275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: c3308761e9d2495e95e127bbc7b9c5e2 Jul 28 04:05:08.387275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:05:08.387275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Jul 28 04:05:08.387275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {"volumeAttachment": {"volumeId": "bfd998d1-f8ff-4163-9fb1-fa513f8153e0"}} Jul 28 04:05:08.387275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:05:08.388192 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Invalid volume: volume bfd998d1-f8ff-4163-9fb1-fa513f8153e0 is already attached to instances: 317bde19-5d15-4691-b014-3e2d001184e7 Jul 28 04:05:08.388192 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'server_id': '317bde19-5d15-4691-b014-3e2d001184e7', 'body': {'volumeAttachment': {'volumeId': 'bfd998d1-f8ff-4163-9fb1-fa513f8153e0'}}} Jul 28 04:05:08.388192 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:05:08.388192 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:08.388192 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 28 04:05:08.388192 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 28 04:05:08.388192 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 239, in inner Jul 28 04:05:08.388192 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 28 04:05:08.388192 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 165, in inner Jul 28 04:05:08.388192 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 28 04:05:08.388192 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5067, in attach_volume Jul 28 04:05:08.388192 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 28 04:05:08.388192 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4907, in _check_volume_already_attached Jul 28 04:05:08.388192 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 28 04:05:08.388192 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bfd998d1-f8ff-4163-9fb1-fa513f8153e0 is already attached to instances: 317bde19-5d15-4691-b014-3e2d001184e7 Jul 28 04:05:08.388192 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:05:08.388192 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:08.388192 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:05:08.388192 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:08.389399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:08.389399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:08.389399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:05:08.389399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:05:08.389399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:05:08.389399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:05:08.389399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:05:08.389399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:05:08.389399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:05:08.389399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:05:08.389399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 28 04:05:08.389399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 28 04:05:08.389399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 28 04:05:08.389399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 28 04:05:08.389399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bfd998d1-f8ff-4163-9fb1-fa513f8153e0 is already attached to instances: 317bde19-5d15-4691-b014-3e2d001184e7 Jul 28 04:05:08.389399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:05:08.389399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:08.389399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:05:08.389399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:08.389399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:08.390591 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:08.390591 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:05:08.390591 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:05:08.390591 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bfd998d1-f8ff-4163-9fb1-fa513f8153e0 is already attached to instances: 317bde19-5d15-4691-b014-3e2d001184e7 Jul 28 04:05:08.390591 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:05:08.390591 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d005c5ce-5a7a-4328-83bd-6472549c1196 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Returning 400 to user: Invalid volume: volume bfd998d1-f8ff-4163-9fb1-fa513f8153e0 is already attached to instances: 317bde19-5d15-4691-b014-3e2d001184e7 {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:05:08.390591 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d005c5ce-5a7a-4328-83bd-6472549c1196 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "POST /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101532 Jul 28 04:05:08.390591 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 355/656] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Jul 28 04:05:08 2022] POST /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 28 04:05:08.451146 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-731789af-950a-4eda-aa2b-53842775ab42 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:08.451724 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-731789af-950a-4eda-aa2b-53842775ab42 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:08.458435 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-731789af-950a-4eda-aa2b-53842775ab42 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:08.458917 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-731789af-950a-4eda-aa2b-53842775ab42 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:08.459665 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-731789af-950a-4eda-aa2b-53842775ab42 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:08.460121 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-731789af-950a-4eda-aa2b-53842775ab42 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:08.539153 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.objects.instance [None req-731789af-950a-4eda-aa2b-53842775ab42 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lazy-loading 'services' on Instance uuid 317bde19-5d15-4691-b014-3e2d001184e7 {{(pid=118186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:05:08.611135 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-731789af-950a-4eda-aa2b-53842775ab42 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "DELETE /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7/os-volume_attachments/bfd998d1-f8ff-4163-9fb1-fa513f8153e0" status: 202 len: 0 microversion: 2.1 time: 0.164052 Jul 28 04:05:08.612864 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 302/657] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Jul 28 04:05:08 2022] DELETE /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7/os-volume_attachments/bfd998d1-f8ff-4163-9fb1-fa513f8153e0 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:05:08.621437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f12fb0ea-8078-4bb7-88b7-af888538b9db tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:08.623576 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f12fb0ea-8078-4bb7-88b7-af888538b9db tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:08.632498 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f12fb0ea-8078-4bb7-88b7-af888538b9db tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:08.632948 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f12fb0ea-8078-4bb7-88b7-af888538b9db tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:08.633715 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f12fb0ea-8078-4bb7-88b7-af888538b9db tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:08.634146 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f12fb0ea-8078-4bb7-88b7-af888538b9db tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:08.668038 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f12fb0ea-8078-4bb7-88b7-af888538b9db tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050610 Jul 28 04:05:08.668596 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 356/658] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Jul 28 04:05:08 2022] GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:09.682180 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-91786986-542a-4f90-9601-8c871a6906f6 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:09.684429 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-91786986-542a-4f90-9601-8c871a6906f6 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:09.690683 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-91786986-542a-4f90-9601-8c871a6906f6 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:09.691164 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-91786986-542a-4f90-9601-8c871a6906f6 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:09.691929 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-91786986-542a-4f90-9601-8c871a6906f6 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:09.692367 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-91786986-542a-4f90-9601-8c871a6906f6 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:09.722060 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-91786986-542a-4f90-9601-8c871a6906f6 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044003 Jul 28 04:05:09.722871 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 303/659] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Jul 28 04:05:09 2022] GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:05:09.782873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-58bccf35-80e1-4960-a9d8-4d432b999b7c tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:09.784026 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-58bccf35-80e1-4960-a9d8-4d432b999b7c tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:09.790977 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-58bccf35-80e1-4960-a9d8-4d432b999b7c tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:09.791383 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-58bccf35-80e1-4960-a9d8-4d432b999b7c tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:09.792162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-58bccf35-80e1-4960-a9d8-4d432b999b7c tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:09.792606 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-58bccf35-80e1-4960-a9d8-4d432b999b7c tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:09.818292 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-58bccf35-80e1-4960-a9d8-4d432b999b7c tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Going to try to terminate instance {{(pid=118187) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:05:09.895986 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-36bbb5df-d2f6-4d70-bf72-d6ca0c16d66e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:09.897015 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-36bbb5df-d2f6-4d70-bf72-d6ca0c16d66e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:09.897586 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-58bccf35-80e1-4960-a9d8-4d432b999b7c tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "DELETE /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7" status: 204 len: 0 microversion: 2.1 time: 0.118254 Jul 28 04:05:09.898179 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 357/660] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:05:09 2022] DELETE /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:05:09.904043 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-36bbb5df-d2f6-4d70-bf72-d6ca0c16d66e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:09.904493 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-36bbb5df-d2f6-4d70-bf72-d6ca0c16d66e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:09.905260 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-36bbb5df-d2f6-4d70-bf72-d6ca0c16d66e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:09.905691 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-36bbb5df-d2f6-4d70-bf72-d6ca0c16d66e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:09.906768 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-56cf9f24-052a-44e2-8768-bd40738b2651 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:09.907499 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-56cf9f24-052a-44e2-8768-bd40738b2651 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:09.913761 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-56cf9f24-052a-44e2-8768-bd40738b2651 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:09.914214 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-56cf9f24-052a-44e2-8768-bd40738b2651 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:09.914997 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-56cf9f24-052a-44e2-8768-bd40738b2651 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:09.915431 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-56cf9f24-052a-44e2-8768-bd40738b2651 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:09.990021 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.objects.instance [None req-36bbb5df-d2f6-4d70-bf72-d6ca0c16d66e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lazy-loading 'services' on Instance uuid fe24f923-0389-4154-a7bb-062800043d11 {{(pid=118186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:05:10.050007 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-56cf9f24-052a-44e2-8768-bd40738b2651 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:10.058296 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-56cf9f24-052a-44e2-8768-bd40738b2651 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7" status: 200 len: 1682 microversion: 2.1 time: 0.155722 Jul 28 04:05:10.058968 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 358/661] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:09 2022] GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:05:10.072868 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-36bbb5df-d2f6-4d70-bf72-d6ca0c16d66e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "DELETE /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11/os-volume_attachments/f4ddd6fc-8893-41bd-927a-c256e0e3e7ee" status: 202 len: 0 microversion: 2.1 time: 0.181711 Jul 28 04:05:10.073476 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 304/662] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Jul 28 04:05:09 2022] DELETE /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11/os-volume_attachments/f4ddd6fc-8893-41bd-927a-c256e0e3e7ee => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:05:10.082262 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8772ac74-5da4-4057-8a5b-af2d3da28076 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:10.084565 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8772ac74-5da4-4057-8a5b-af2d3da28076 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:10.090614 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8772ac74-5da4-4057-8a5b-af2d3da28076 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:10.091109 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8772ac74-5da4-4057-8a5b-af2d3da28076 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:10.091877 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8772ac74-5da4-4057-8a5b-af2d3da28076 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:10.092321 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8772ac74-5da4-4057-8a5b-af2d3da28076 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:10.096058 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:10.122917 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8772ac74-5da4-4057-8a5b-af2d3da28076 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045141 Jul 28 04:05:10.123470 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 359/663] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Jul 28 04:05:10 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:11.082092 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-5a7f06d2-8fd9-4614-9d58-648751adfef1 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:11.082808 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-5a7f06d2-8fd9-4614-9d58-648751adfef1 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:11.089110 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5a7f06d2-8fd9-4614-9d58-648751adfef1 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:11.089557 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5a7f06d2-8fd9-4614-9d58-648751adfef1 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:11.090311 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5a7f06d2-8fd9-4614-9d58-648751adfef1 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:11.090745 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5a7f06d2-8fd9-4614-9d58-648751adfef1 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:11.136048 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a3af1f9b-5812-4762-8462-016c1310a9ad tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:11.138237 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a3af1f9b-5812-4762-8462-016c1310a9ad tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:11.145350 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a3af1f9b-5812-4762-8462-016c1310a9ad tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:11.145793 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a3af1f9b-5812-4762-8462-016c1310a9ad tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:11.146556 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a3af1f9b-5812-4762-8462-016c1310a9ad tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:11.147020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a3af1f9b-5812-4762-8462-016c1310a9ad tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:11.177403 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a3af1f9b-5812-4762-8462-016c1310a9ad tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045258 Jul 28 04:05:11.177975 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 360/664] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Jul 28 04:05:11 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:05:11.231056 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-5a7f06d2-8fd9-4614-9d58-648751adfef1 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:11.240048 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-5a7f06d2-8fd9-4614-9d58-648751adfef1 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7" status: 200 len: 1682 microversion: 2.1 time: 0.163222 Jul 28 04:05:11.240616 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 305/665] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:11 2022] GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7 => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:12.191208 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-61a784fe-f187-4ea8-a3ce-d56553612101 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:12.193548 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-61a784fe-f187-4ea8-a3ce-d56553612101 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:12.199964 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-61a784fe-f187-4ea8-a3ce-d56553612101 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:12.200412 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-61a784fe-f187-4ea8-a3ce-d56553612101 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:12.201187 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-61a784fe-f187-4ea8-a3ce-d56553612101 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:12.201621 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-61a784fe-f187-4ea8-a3ce-d56553612101 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:12.236241 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-61a784fe-f187-4ea8-a3ce-d56553612101 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050159 Jul 28 04:05:12.238116 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 361/666] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Jul 28 04:05:12 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:05:12.261405 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-22f75e33-ce50-47cf-b5a7-3968b7dbf2ab tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:12.262241 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-22f75e33-ce50-47cf-b5a7-3968b7dbf2ab tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:12.269501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-22f75e33-ce50-47cf-b5a7-3968b7dbf2ab tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:12.269501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-22f75e33-ce50-47cf-b5a7-3968b7dbf2ab tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:12.269988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-22f75e33-ce50-47cf-b5a7-3968b7dbf2ab tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:12.270419 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-22f75e33-ce50-47cf-b5a7-3968b7dbf2ab tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:12.305038 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=3,nova_cell1:INSERT=4 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:12.322074 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-118674c0-417d-4852-b79c-099a8492df03 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:12.322659 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-118674c0-417d-4852-b79c-099a8492df03 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:12.328854 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-118674c0-417d-4852-b79c-099a8492df03 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:12.329403 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-118674c0-417d-4852-b79c-099a8492df03 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:12.330302 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-118674c0-417d-4852-b79c-099a8492df03 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:12.330836 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-118674c0-417d-4852-b79c-099a8492df03 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:12.357911 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-118674c0-417d-4852-b79c-099a8492df03 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Going to try to terminate instance {{(pid=118187) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:05:12.398219 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-22f75e33-ce50-47cf-b5a7-3968b7dbf2ab tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:12.406694 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-22f75e33-ce50-47cf-b5a7-3968b7dbf2ab tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7" status: 200 len: 1614 microversion: 2.1 time: 0.149016 Jul 28 04:05:12.407310 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 306/667] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:12 2022] GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7 => generated 1614 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:12.444017 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-118674c0-417d-4852-b79c-099a8492df03 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "DELETE /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 204 len: 0 microversion: 2.1 time: 0.125507 Jul 28 04:05:12.445113 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 362/668] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:05:12 2022] DELETE /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:05:12.453953 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-990b7c4d-d49e-450c-957c-f0b105e68173 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:12.454604 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-990b7c4d-d49e-450c-957c-f0b105e68173 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:12.461254 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-990b7c4d-d49e-450c-957c-f0b105e68173 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:12.461753 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-990b7c4d-d49e-450c-957c-f0b105e68173 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:12.462552 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-990b7c4d-d49e-450c-957c-f0b105e68173 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:12.463016 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-990b7c4d-d49e-450c-957c-f0b105e68173 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:12.649698 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-afdf25f1-8255-4bd9-ba22-87dc1bcdc2b3 req-ff7d3295-2196-4276-b572-3f081c2f0589 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "317bde19-5d15-4691-b014-3e2d001184e7", "name": "network-vif-deleted", "tag": "4e24c96f-28ee-4033-a629-7e7de2eef4db"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:12.659734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-afdf25f1-8255-4bd9-ba22-87dc1bcdc2b3 req-ff7d3295-2196-4276-b572-3f081c2f0589 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:12.660185 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-afdf25f1-8255-4bd9-ba22-87dc1bcdc2b3 req-ff7d3295-2196-4276-b572-3f081c2f0589 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:12.672490 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-afdf25f1-8255-4bd9-ba22-87dc1bcdc2b3 req-ff7d3295-2196-4276-b572-3f081c2f0589 service nova] Creating event network-vif-deleted:4e24c96f-28ee-4033-a629-7e7de2eef4db for instance 317bde19-5d15-4691-b014-3e2d001184e7 on hv-cinder-79987 Jul 28 04:05:12.678632 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-990b7c4d-d49e-450c-957c-f0b105e68173 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:12.678912 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-afdf25f1-8255-4bd9-ba22-87dc1bcdc2b3 req-ff7d3295-2196-4276-b572-3f081c2f0589 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032985 Jul 28 04:05:12.679581 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 363/669] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:05:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:05:12.688515 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-990b7c4d-d49e-450c-957c-f0b105e68173 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1690 microversion: 2.1 time: 0.238414 Jul 28 04:05:12.689073 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 307/670] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:12 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1690 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:13.430730 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3eb3f814-0667-4cbb-b244-bf7b1e0c235f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:13.431485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3eb3f814-0667-4cbb-b244-bf7b1e0c235f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:13.437974 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3eb3f814-0667-4cbb-b244-bf7b1e0c235f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:13.438420 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3eb3f814-0667-4cbb-b244-bf7b1e0c235f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:13.439248 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3eb3f814-0667-4cbb-b244-bf7b1e0c235f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:13.440445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3eb3f814-0667-4cbb-b244-bf7b1e0c235f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:13.508332 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3eb3f814-0667-4cbb-b244-bf7b1e0c235f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:13.516107 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3eb3f814-0667-4cbb-b244-bf7b1e0c235f tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7" status: 200 len: 1614 microversion: 2.1 time: 0.090089 Jul 28 04:05:13.516702 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 364/671] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:13 2022] GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7 => generated 1614 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:13.710509 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a7d39cfc-eb65-4272-83b0-dc3335fd1de9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:13.711161 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-a7d39cfc-eb65-4272-83b0-dc3335fd1de9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:13.717998 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a7d39cfc-eb65-4272-83b0-dc3335fd1de9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:13.718448 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a7d39cfc-eb65-4272-83b0-dc3335fd1de9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:13.719243 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a7d39cfc-eb65-4272-83b0-dc3335fd1de9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:13.719690 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a7d39cfc-eb65-4272-83b0-dc3335fd1de9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:13.873049 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-a7d39cfc-eb65-4272-83b0-dc3335fd1de9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:13.881438 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-a7d39cfc-eb65-4272-83b0-dc3335fd1de9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1690 microversion: 2.1 time: 0.175115 Jul 28 04:05:13.882015 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 308/672] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:13 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1690 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:14.538609 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c2c6c5bb-fe41-4173-8ae0-61053a1edd8d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:14.539002 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c2c6c5bb-fe41-4173-8ae0-61053a1edd8d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:14.545478 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c2c6c5bb-fe41-4173-8ae0-61053a1edd8d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:14.545931 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c2c6c5bb-fe41-4173-8ae0-61053a1edd8d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:14.546701 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c2c6c5bb-fe41-4173-8ae0-61053a1edd8d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:14.547171 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c2c6c5bb-fe41-4173-8ae0-61053a1edd8d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:14.609072 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c2c6c5bb-fe41-4173-8ae0-61053a1edd8d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:14.617061 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c2c6c5bb-fe41-4173-8ae0-61053a1edd8d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7" status: 200 len: 1614 microversion: 2.1 time: 0.083643 Jul 28 04:05:14.617623 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 365/673] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:14 2022] GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7 => generated 1614 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:14.902873 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-b641d459-5972-4ebe-807f-1933128126f0 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:14.903499 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-b641d459-5972-4ebe-807f-1933128126f0 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:14.910507 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b641d459-5972-4ebe-807f-1933128126f0 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:14.910991 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b641d459-5972-4ebe-807f-1933128126f0 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:14.912014 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b641d459-5972-4ebe-807f-1933128126f0 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:14.912452 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b641d459-5972-4ebe-807f-1933128126f0 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:15.043752 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-b641d459-5972-4ebe-807f-1933128126f0 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:15.051739 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-b641d459-5972-4ebe-807f-1933128126f0 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1690 microversion: 2.1 time: 0.152726 Jul 28 04:05:15.052305 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 309/674] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:14 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1690 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:15.637414 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-dc2865a0-170c-4b74-855a-6f753d34eee6 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:15.638031 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-dc2865a0-170c-4b74-855a-6f753d34eee6 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:15.645395 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dc2865a0-170c-4b74-855a-6f753d34eee6 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:15.645852 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dc2865a0-170c-4b74-855a-6f753d34eee6 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:15.646611 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dc2865a0-170c-4b74-855a-6f753d34eee6 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:15.647082 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dc2865a0-170c-4b74-855a-6f753d34eee6 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:15.678183 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dc2865a0-170c-4b74-855a-6f753d34eee6 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:15.678631 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dc2865a0-170c-4b74-855a-6f753d34eee6 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:15.679106 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.objects.instance [None req-dc2865a0-170c-4b74-855a-6f753d34eee6 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lazy-loading 'fault' on Instance uuid 317bde19-5d15-4691-b014-3e2d001184e7 {{(pid=118187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:05:15.719453 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-dc2865a0-170c-4b74-855a-6f753d34eee6 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:15.727100 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-dc2865a0-170c-4b74-855a-6f753d34eee6 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7" status: 200 len: 1331 microversion: 2.1 time: 0.093511 Jul 28 04:05:15.727671 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 366/675] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:15 2022] GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7 => generated 1331 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:16.072437 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-4c0dc19a-b615-47f8-9159-0c4ad044901e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:16.073091 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-4c0dc19a-b615-47f8-9159-0c4ad044901e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:16.079545 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4c0dc19a-b615-47f8-9159-0c4ad044901e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:16.080029 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4c0dc19a-b615-47f8-9159-0c4ad044901e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:16.081574 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4c0dc19a-b615-47f8-9159-0c4ad044901e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:16.083171 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4c0dc19a-b615-47f8-9159-0c4ad044901e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:16.335493 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-4c0dc19a-b615-47f8-9159-0c4ad044901e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:16.343068 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-4c0dc19a-b615-47f8-9159-0c4ad044901e tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 200 len: 1690 microversion: 2.1 time: 0.274506 Jul 28 04:05:16.343644 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 310/676] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:16 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 1690 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:16.749294 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-54ca73b8-d871-497a-ba62-171eb32721f4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:16.749839 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-54ca73b8-d871-497a-ba62-171eb32721f4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:16.758344 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-54ca73b8-d871-497a-ba62-171eb32721f4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:16.758822 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-54ca73b8-d871-497a-ba62-171eb32721f4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:16.759741 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-54ca73b8-d871-497a-ba62-171eb32721f4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:16.760101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-54ca73b8-d871-497a-ba62-171eb32721f4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:16.775930 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-54ca73b8-d871-497a-ba62-171eb32721f4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] HTTP exception thrown: Instance 317bde19-5d15-4691-b014-3e2d001184e7 could not be found. Jul 28 04:05:16.777603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-54ca73b8-d871-497a-ba62-171eb32721f4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Request method failure captured: Jul 28 04:05:16.777603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7 HTTP/1.1 Jul 28 04:05:16.777603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:05:16.777603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:05:16.777603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:05:16.777603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:05:16.777603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:05:16.777603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:05:16.777603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:05:16.777603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:05:16.777603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gmoXQtNoyNZeVOBtHeH0p0IZl6gLmXu7uMplYaqMcIU3TXk6NAztCb7-3xvXPbqffriel8JQiqKAHgD2FYfvE1RoXCiUMTvpIZjixGVtBiBXhQr6lOIK0tmH4bMvCgHENHbbkhJpWpz1XJYt5CJBH3JqJi5ypO8pp_YsE0VFSnKOUI Jul 28 04:05:16.777603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:05:16.777603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:05:16.777603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:05:16.777603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:05:16.777603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:05:16.777603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:05:16.777603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:05:16.777603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:05:16.777603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:05:16.777603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:05:16.779288 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_18a927e9f5da42d7b34752c8b2db211a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/18a927e9f5da42d7b34752c8b2db211a"}]}] Jul 28 04:05:16.779288 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:05:16.779288 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:05:16.779288 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:05:16.779288 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:05:16.779288 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:05:16.779288 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:05:16.779288 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: c3308761e9d2495e95e127bbc7b9c5e2 Jul 28 04:05:16.779288 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:05:16.779288 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:05:16.779288 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Instance 317bde19-5d15-4691-b014-3e2d001184e7 could not be found. Jul 28 04:05:16.779288 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': '317bde19-5d15-4691-b014-3e2d001184e7'} Jul 28 04:05:16.780175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:05:16.780175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:16.780175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:05:16.780175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:05:16.780175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:05:16.780175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:05:16.780175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:05:16.780175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:05:16.780175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:05:16.780175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:05:16.780175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317bde19-5d15-4691-b014-3e2d001184e7 could not be found. Jul 28 04:05:16.780175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:05:16.780175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:16.780175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:05:16.780175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:16.780175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:16.780175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:16.780175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:05:16.780175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:05:16.780175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:05:16.781390 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:05:16.781390 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:05:16.781390 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:05:16.781390 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:05:16.781390 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:05:16.781390 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:05:16.781390 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:05:16.781390 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317bde19-5d15-4691-b014-3e2d001184e7 could not be found. Jul 28 04:05:16.781390 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:05:16.781390 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:16.781390 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:05:16.781390 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:16.781390 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:16.781390 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:16.781390 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:05:16.781390 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:05:16.781390 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317bde19-5d15-4691-b014-3e2d001184e7 could not be found. Jul 28 04:05:16.781390 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:05:16.782444 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-54ca73b8-d871-497a-ba62-171eb32721f4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Returning 404 to user: Instance 317bde19-5d15-4691-b014-3e2d001184e7 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:05:16.782444 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-54ca73b8-d871-497a-ba62-171eb32721f4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7" status: 404 len: 111 microversion: 2.1 time: 0.034063 Jul 28 04:05:16.784679 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 367/677] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:16 2022] GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:05:16.789974 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-dc6b9d23-4828-4803-9f6b-72aab5f119fc tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '.version_select at 0x7fa6ee0425e0>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:16.797923 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-628fa1b3-9db0-4203-b742-56757623ca15 req-d5321807-7d25-4464-8ace-1975f4a6b40a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe24f923-0389-4154-a7bb-062800043d11", "name": "network-vif-deleted", "tag": "606d30e1-9cda-4404-8c90-b1f1e3b45f28"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:16.808975 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-628fa1b3-9db0-4203-b742-56757623ca15 req-d5321807-7d25-4464-8ace-1975f4a6b40a service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:16.809850 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-628fa1b3-9db0-4203-b742-56757623ca15 req-d5321807-7d25-4464-8ace-1975f4a6b40a service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:16.825275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-dc6b9d23-4828-4803-9f6b-72aab5f119fc tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1612336144" status: 202 len: 0 microversion: 2.1 time: 0.037007 Jul 28 04:05:16.826369 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 368/678] 10.222.0.46 () {58 vars in 1221 bytes} [Thu Jul 28 04:05:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1612336144 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:05:16.828511 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-628fa1b3-9db0-4203-b742-56757623ca15 req-d5321807-7d25-4464-8ace-1975f4a6b40a service nova] Creating event network-vif-deleted:606d30e1-9cda-4404-8c90-b1f1e3b45f28 for instance fe24f923-0389-4154-a7bb-062800043d11 on hv-cinder-79987 Jul 28 04:05:16.835017 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-628fa1b3-9db0-4203-b742-56757623ca15 req-d5321807-7d25-4464-8ace-1975f4a6b40a service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058038 Jul 28 04:05:16.836242 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 311/679] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:05:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:17.368530 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-db0b0266-dcfc-482d-87c1-0dd9e8ba49af tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:17.369560 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-db0b0266-dcfc-482d-87c1-0dd9e8ba49af tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: fe24f923-0389-4154-a7bb-062800043d11] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:17.377796 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-db0b0266-dcfc-482d-87c1-0dd9e8ba49af tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:17.378739 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-db0b0266-dcfc-482d-87c1-0dd9e8ba49af tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:17.379784 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-db0b0266-dcfc-482d-87c1-0dd9e8ba49af tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:17.380308 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-db0b0266-dcfc-482d-87c1-0dd9e8ba49af tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:17.402638 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-db0b0266-dcfc-482d-87c1-0dd9e8ba49af tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] HTTP exception thrown: Instance fe24f923-0389-4154-a7bb-062800043d11 could not be found. Jul 28 04:05:17.404426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-db0b0266-dcfc-482d-87c1-0dd9e8ba49af tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Request method failure captured: Jul 28 04:05:17.404426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 HTTP/1.1 Jul 28 04:05:17.404426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:05:17.404426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:05:17.404426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:05:17.404426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:05:17.404426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:05:17.404426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:05:17.404426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:05:17.404426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:05:17.404426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gmx9saU6X6wXaut0oV-DgXC4eOrOdUPDpTL-be51IOCob459Vnx3p8cEv5I-817MPvea-z5B1wjBZmkZVFZyS4Z5HE0xs4B5dv5vHGJrJ18ZwqUg2jQyx-xGnyCE7MhhFmKrX3UvKtRA53M9fiu3ycBzv2wFrj6Q7c0TYYzfm06pvY Jul 28 04:05:17.404426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:05:17.404426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:05:17.404426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:05:17.404426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:05:17.404426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:05:17.404426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:05:17.404426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 6ca5212b1a1743f2910407d7b8ba7aaf Jul 28 04:05:17.404426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1523098003 Jul 28 04:05:17.404426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:05:17.404426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:05:17.405777 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6ca5212b1a1743f2910407d7b8ba7aaf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ca5212b1a1743f2910407d7b8ba7aaf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ca5212b1a1743f2910407d7b8ba7aaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6ca5212b1a1743f2910407d7b8ba7aaf"}]}] Jul 28 04:05:17.405777 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1523098003 Jul 28 04:05:17.405777 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 6ca5212b1a1743f2910407d7b8ba7aaf Jul 28 04:05:17.405777 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1523098003 Jul 28 04:05:17.405777 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-ServerRescueNegativeTestJSON-1523098003-project Jul 28 04:05:17.405777 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:05:17.405777 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:05:17.405777 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: 72dbbd19e4454bee84fe5bc797497bd0 Jul 28 04:05:17.405777 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1523098003-project Jul 28 04:05:17.405777 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:05:17.405777 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Instance fe24f923-0389-4154-a7bb-062800043d11 could not be found. Jul 28 04:05:17.405777 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': 'fe24f923-0389-4154-a7bb-062800043d11'} Jul 28 04:05:17.406628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:05:17.406628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:17.406628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:05:17.406628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:05:17.406628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:05:17.406628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:05:17.406628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:05:17.406628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:05:17.406628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:05:17.406628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:05:17.406628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe24f923-0389-4154-a7bb-062800043d11 could not be found. Jul 28 04:05:17.406628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:05:17.406628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:17.406628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:05:17.406628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:17.406628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:17.406628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:17.406628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:05:17.406628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:05:17.406628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:05:17.408759 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:05:17.408759 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:05:17.408759 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:05:17.408759 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:05:17.408759 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:05:17.408759 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:05:17.408759 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:05:17.408759 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe24f923-0389-4154-a7bb-062800043d11 could not be found. Jul 28 04:05:17.408759 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:05:17.408759 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:17.408759 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:05:17.408759 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:17.408759 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:17.408759 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:17.408759 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:05:17.408759 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:05:17.408759 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe24f923-0389-4154-a7bb-062800043d11 could not be found. Jul 28 04:05:17.408759 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:05:17.418641 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-db0b0266-dcfc-482d-87c1-0dd9e8ba49af tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Returning 404 to user: Instance fe24f923-0389-4154-a7bb-062800043d11 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:05:17.418641 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-db0b0266-dcfc-482d-87c1-0dd9e8ba49af tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11" status: 404 len: 111 microversion: 2.1 time: 0.043602 Jul 28 04:05:17.418641 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 369/680] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:17 2022] GET /compute/v2.1/servers/fe24f923-0389-4154-a7bb-062800043d11 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:05:17.420258 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-cb1a3365-abd3-49d2-ae5a-3cce52290240 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '.version_select at 0x7fa6ee035430>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:17.441850 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-cb1a3365-abd3-49d2-ae5a-3cce52290240 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-369653909" status: 202 len: 0 microversion: 2.1 time: 0.028371 Jul 28 04:05:17.445797 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 312/681] 10.222.0.46 () {58 vars in 1218 bytes} [Thu Jul 28 04:05:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-369653909 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:05:17.530586 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-bb2e6dd4-92db-46c3-8b1b-1fa4d402aa93 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Action: 'create', calling method: .version_select at 0x7fa6ee020e50>, body: {"keypair": {"name": "tempest-keypair-812196330", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBmeb4kQJYHMq/E4XQBoq7Q3HeCIuBURl9ssdypUhAYAXabT8TQryHc/Ag1nn5fT+218e34V8UItwPnFAuPnb5IMeLO4dc1jxvar/3fnSuo6RIY0FlZ3RKRHKnaXeYQRPg=="}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:17.546652 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-bb2e6dd4-92db-46c3-8b1b-1fa4d402aa93 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Getting quotas for project 18a927e9f5da42d7b34752c8b2db211a. Resources: {'key_pairs'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:05:17.551396 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-bb2e6dd4-92db-46c3-8b1b-1fa4d402aa93 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Getting quotas for user c3308761e9d2495e95e127bbc7b9c5e2 and project 18a927e9f5da42d7b34752c8b2db211a. Resources: {'key_pairs'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:05:17.554730 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:17.578548 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-bb2e6dd4-92db-46c3-8b1b-1fa4d402aa93 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051836 Jul 28 04:05:17.579497 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 370/682] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 04:05:17 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:19.110386 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c84bd072-e769-4d2a-96d5-514879cf84c0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-594833690", "imageRef": "a0eec51c-83e9-420b-bcb9-20fe8dcf5321", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "21c60ecd-c113-4857-a1b5-c85ec6a7053f"}], "security_groups": [{"name": "tempest-securitygroup--1180648204"}], "key_name": "tempest-keypair-812196330", "user_data": "}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:19.119474 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:19.214635 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.network.neutron [None req-c84bd072-e769-4d2a-96d5-514879cf84c0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] validate_networks() for [('21c60ecd-c113-4857-a1b5-c85ec6a7053f', None, None, None, None, None)] {{(pid=118186) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:05:19.636517 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-c84bd072-e769-4d2a-96d5-514879cf84c0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Flavor limits 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:05:19.636943 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-c84bd072-e769-4d2a-96d5-514879cf84c0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Image limits 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:05:19.637421 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-c84bd072-e769-4d2a-96d5-514879cf84c0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Flavor pref 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:05:19.637840 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-c84bd072-e769-4d2a-96d5-514879cf84c0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Image pref 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:05:19.638252 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-c84bd072-e769-4d2a-96d5-514879cf84c0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:05:19.647499 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c84bd072-e769-4d2a-96d5-514879cf84c0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:19.647959 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c84bd072-e769-4d2a-96d5-514879cf84c0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:19.648754 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c84bd072-e769-4d2a-96d5-514879cf84c0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:19.649196 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c84bd072-e769-4d2a-96d5-514879cf84c0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:19.666074 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-c84bd072-e769-4d2a-96d5-514879cf84c0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Getting quotas for project 18a927e9f5da42d7b34752c8b2db211a. Resources: {'instances', 'cores', 'ram'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:05:19.670010 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-c84bd072-e769-4d2a-96d5-514879cf84c0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Getting quotas for user c3308761e9d2495e95e127bbc7b9c5e2 and project 18a927e9f5da42d7b34752c8b2db211a. Resources: {'instances', 'cores', 'ram'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:05:19.682095 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c84bd072-e769-4d2a-96d5-514879cf84c0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Going to run 1 instances... {{(pid=118186) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:05:19.684460 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c84bd072-e769-4d2a-96d5-514879cf84c0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0eec51c-83e9-420b-bcb9-20fe8dcf5321',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:05:19.729293 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-c84bd072-e769-4d2a-96d5-514879cf84c0 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.623297 Jul 28 04:05:19.729941 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 313/683] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 04:05:19 2022] POST /compute/v2.1/servers => generated 402 bytes in 625 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:05:19.741895 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4d2d967d-d2b3-40d8-afa6-ab7eb625da85 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:19.742520 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-4d2d967d-d2b3-40d8-afa6-ab7eb625da85 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:19.796209 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4d2d967d-d2b3-40d8-afa6-ab7eb625da85 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:19.804444 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4d2d967d-d2b3-40d8-afa6-ab7eb625da85 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150" status: 200 len: 1240 microversion: 2.1 time: 0.067023 Jul 28 04:05:19.805033 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 371/684] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:19 2022] GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150 => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:20.415715 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a5903780-112c-4d05-bd6c-767f1fce5937 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:20.416217 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-a5903780-112c-4d05-bd6c-767f1fce5937 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:20.423258 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a5903780-112c-4d05-bd6c-767f1fce5937 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:20.424230 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a5903780-112c-4d05-bd6c-767f1fce5937 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:20.425144 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a5903780-112c-4d05-bd6c-767f1fce5937 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:20.425585 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a5903780-112c-4d05-bd6c-767f1fce5937 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:20.450056 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-a5903780-112c-4d05-bd6c-767f1fce5937 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Going to try to terminate instance {{(pid=118186) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:05:20.522497 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-a5903780-112c-4d05-bd6c-767f1fce5937 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 204 len: 0 microversion: 2.1 time: 0.111207 Jul 28 04:05:20.523239 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 314/685] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:05:20 2022] DELETE /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:05:20.531210 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-876e3c60-d22d-4284-9802-dd7b7eafa8df tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:20.531854 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-876e3c60-d22d-4284-9802-dd7b7eafa8df tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:20.538760 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-876e3c60-d22d-4284-9802-dd7b7eafa8df tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:20.539242 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-876e3c60-d22d-4284-9802-dd7b7eafa8df tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:20.540004 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-876e3c60-d22d-4284-9802-dd7b7eafa8df tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:20.540449 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-876e3c60-d22d-4284-9802-dd7b7eafa8df tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:20.679359 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-876e3c60-d22d-4284-9802-dd7b7eafa8df tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:20.686766 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-876e3c60-d22d-4284-9802-dd7b7eafa8df tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1507 microversion: 2.1 time: 0.159434 Jul 28 04:05:20.687343 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 372/686] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:20 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:20.826014 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-b3a0693a-4edd-46f9-9cd8-bbd8e3ccc894 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:20.826712 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-b3a0693a-4edd-46f9-9cd8-bbd8e3ccc894 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:20.832873 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b3a0693a-4edd-46f9-9cd8-bbd8e3ccc894 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:20.833316 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b3a0693a-4edd-46f9-9cd8-bbd8e3ccc894 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:20.834062 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b3a0693a-4edd-46f9-9cd8-bbd8e3ccc894 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:20.834490 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b3a0693a-4edd-46f9-9cd8-bbd8e3ccc894 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:20.897712 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-b3a0693a-4edd-46f9-9cd8-bbd8e3ccc894 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:20.905050 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-b3a0693a-4edd-46f9-9cd8-bbd8e3ccc894 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150" status: 200 len: 1300 microversion: 2.1 time: 0.083301 Jul 28 04:05:20.905616 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 315/687] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:20 2022] GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150 => generated 1300 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:21.708422 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c521cdd1-6c2a-49f5-85fd-4d9cb32e66ee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:21.709044 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c521cdd1-6c2a-49f5-85fd-4d9cb32e66ee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:21.715355 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c521cdd1-6c2a-49f5-85fd-4d9cb32e66ee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:21.715812 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c521cdd1-6c2a-49f5-85fd-4d9cb32e66ee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:21.716573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c521cdd1-6c2a-49f5-85fd-4d9cb32e66ee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:21.717015 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c521cdd1-6c2a-49f5-85fd-4d9cb32e66ee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:21.843411 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c521cdd1-6c2a-49f5-85fd-4d9cb32e66ee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:21.851246 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c521cdd1-6c2a-49f5-85fd-4d9cb32e66ee tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1507 microversion: 2.1 time: 0.147320 Jul 28 04:05:21.851813 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 373/688] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:21 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:21.926269 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-870460f4-2c7a-473b-a33e-f93e54c58368 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:21.926918 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-870460f4-2c7a-473b-a33e-f93e54c58368 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:21.933382 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-870460f4-2c7a-473b-a33e-f93e54c58368 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:21.933827 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-870460f4-2c7a-473b-a33e-f93e54c58368 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:21.934583 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-870460f4-2c7a-473b-a33e-f93e54c58368 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:21.935042 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-870460f4-2c7a-473b-a33e-f93e54c58368 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:21.995402 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-870460f4-2c7a-473b-a33e-f93e54c58368 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:22.003391 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-870460f4-2c7a-473b-a33e-f93e54c58368 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150" status: 200 len: 1300 microversion: 2.1 time: 0.081716 Jul 28 04:05:22.003958 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 316/689] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:21 2022] GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150 => generated 1300 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:22.873133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c21136c5-b6c5-4215-9908-a7663c9d096d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:22.873822 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c21136c5-b6c5-4215-9908-a7663c9d096d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:22.881630 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c21136c5-b6c5-4215-9908-a7663c9d096d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:22.882078 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c21136c5-b6c5-4215-9908-a7663c9d096d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:22.882863 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c21136c5-b6c5-4215-9908-a7663c9d096d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:22.883298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c21136c5-b6c5-4215-9908-a7663c9d096d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:23.016998 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c21136c5-b6c5-4215-9908-a7663c9d096d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:23.024767 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c21136c5-b6c5-4215-9908-a7663c9d096d tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 200 len: 1507 microversion: 2.1 time: 0.155522 Jul 28 04:05:23.024964 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-241aff4e-a586-4ad1-ae06-edae1ecd2251 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:23.025551 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-241aff4e-a586-4ad1-ae06-edae1ecd2251 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:23.034166 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-241aff4e-a586-4ad1-ae06-edae1ecd2251 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:23.035297 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-241aff4e-a586-4ad1-ae06-edae1ecd2251 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:23.035512 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 374/690] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:22 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:23.036501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-241aff4e-a586-4ad1-ae06-edae1ecd2251 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:23.037412 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-241aff4e-a586-4ad1-ae06-edae1ecd2251 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:23.402925 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-241aff4e-a586-4ad1-ae06-edae1ecd2251 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:23.413961 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-241aff4e-a586-4ad1-ae06-edae1ecd2251 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150" status: 200 len: 1298 microversion: 2.1 time: 0.393691 Jul 28 04:05:23.414547 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 317/691] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:23 2022] GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150 => generated 1298 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:23.473769 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-b3734200-9a69-454a-8e19-0261b3cca06d req-552ed62e-5cd0-42fb-a1bd-07797c282dfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b9e96863-0e05-4ac4-ba31-95db87337440", "name": "network-vif-deleted", "tag": "e0bdfff3-ee6f-494e-a567-0b6b2b62131c"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:23.487995 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-b3734200-9a69-454a-8e19-0261b3cca06d req-552ed62e-5cd0-42fb-a1bd-07797c282dfe service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:23.488685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-b3734200-9a69-454a-8e19-0261b3cca06d req-552ed62e-5cd0-42fb-a1bd-07797c282dfe service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:23.503948 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-b3734200-9a69-454a-8e19-0261b3cca06d req-552ed62e-5cd0-42fb-a1bd-07797c282dfe service nova] Creating event network-vif-deleted:e0bdfff3-ee6f-494e-a567-0b6b2b62131c for instance b9e96863-0e05-4ac4-ba31-95db87337440 on hv-cinder-79987 Jul 28 04:05:23.510450 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-b3734200-9a69-454a-8e19-0261b3cca06d req-552ed62e-5cd0-42fb-a1bd-07797c282dfe service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040708 Jul 28 04:05:23.511445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 375/692] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:05:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:24.047450 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-99a9bdca-9616-4d82-9ba4-394fba606500 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:24.048069 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-99a9bdca-9616-4d82-9ba4-394fba606500 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: b9e96863-0e05-4ac4-ba31-95db87337440] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:24.054609 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-99a9bdca-9616-4d82-9ba4-394fba606500 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:24.055072 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-99a9bdca-9616-4d82-9ba4-394fba606500 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:24.055838 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-99a9bdca-9616-4d82-9ba4-394fba606500 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:24.056270 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-99a9bdca-9616-4d82-9ba4-394fba606500 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:24.069805 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.wsgi [None req-99a9bdca-9616-4d82-9ba4-394fba606500 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] HTTP exception thrown: Instance b9e96863-0e05-4ac4-ba31-95db87337440 could not be found. Jul 28 04:05:24.071524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-99a9bdca-9616-4d82-9ba4-394fba606500 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Request method failure captured: Jul 28 04:05:24.071524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: request: GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 HTTP/1.1 Jul 28 04:05:24.071524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept: application/json Jul 28 04:05:24.071524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept-Encoding: identity Jul 28 04:05:24.071524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Connection: close Jul 28 04:05:24.071524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Length: 0 Jul 28 04:05:24.071524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Type: application/json Jul 28 04:05:24.071524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Host: 10.222.0.46 Jul 28 04:05:24.071524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Openstack-System-Scope: None Jul 28 04:05:24.071524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: User-Agent: python-urllib3/1.26.10 Jul 28 04:05:24.071524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Auth-Token: gAAAAABi4gmx9saU6X6wXaut0oV-DgXC4eOrOdUPDpTL-be51IOCob459Vnx3p8cEv5I-817MPvea-z5B1wjBZmkZVFZyS4Z5HE0xs4B5dv5vHGJrJ18ZwqUg2jQyx-xGnyCE7MhhFmKrX3UvKtRA53M9fiu3ycBzv2wFrj6Q7c0TYYzfm06pvY Jul 28 04:05:24.071524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Id: None Jul 28 04:05:24.071524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Name: None Jul 28 04:05:24.071524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Identity-Status: Confirmed Jul 28 04:05:24.071524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Is-Admin-Project: True Jul 28 04:05:24.071524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Id: default Jul 28 04:05:24.071524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Name: Default Jul 28 04:05:24.071524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Id: 6ca5212b1a1743f2910407d7b8ba7aaf Jul 28 04:05:24.071524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1523098003 Jul 28 04:05:24.071524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Role: reader,member Jul 28 04:05:24.071524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Roles: reader,member Jul 28 04:05:24.073016 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6ca5212b1a1743f2910407d7b8ba7aaf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ca5212b1a1743f2910407d7b8ba7aaf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ca5212b1a1743f2910407d7b8ba7aaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6ca5212b1a1743f2910407d7b8ba7aaf"}]}] Jul 28 04:05:24.073016 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1523098003 Jul 28 04:05:24.073016 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Id: 6ca5212b1a1743f2910407d7b8ba7aaf Jul 28 04:05:24.073016 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1523098003 Jul 28 04:05:24.073016 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User: tempest-ServerRescueNegativeTestJSON-1523098003-project Jul 28 04:05:24.073016 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Id: default Jul 28 04:05:24.073016 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Name: Default Jul 28 04:05:24.073016 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Id: 72dbbd19e4454bee84fe5bc797497bd0 Jul 28 04:05:24.073016 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1523098003-project Jul 28 04:05:24.073016 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: method: > Jul 28 04:05:24.073016 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: exception: Instance b9e96863-0e05-4ac4-ba31-95db87337440 could not be found. Jul 28 04:05:24.073016 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: action_args: {'id': 'b9e96863-0e05-4ac4-ba31-95db87337440'} Jul 28 04:05:24.073828 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:05:24.073828 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:24.073828 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:05:24.073828 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:05:24.073828 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:05:24.073828 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:05:24.073828 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:05:24.073828 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:05:24.073828 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:05:24.073828 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:05:24.073828 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b9e96863-0e05-4ac4-ba31-95db87337440 could not be found. Jul 28 04:05:24.073828 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:05:24.073828 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:24.073828 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:05:24.073828 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:24.073828 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:24.073828 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:24.073828 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:05:24.073828 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:05:24.073828 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:05:24.075117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:05:24.075117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:05:24.075117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:05:24.075117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:05:24.075117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:05:24.075117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:05:24.075117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:05:24.075117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b9e96863-0e05-4ac4-ba31-95db87337440 could not be found. Jul 28 04:05:24.075117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:05:24.075117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:24.075117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:05:24.075117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:24.075117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:24.075117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:24.075117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:05:24.075117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:05:24.075117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b9e96863-0e05-4ac4-ba31-95db87337440 could not be found. Jul 28 04:05:24.075117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:05:24.076299 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-99a9bdca-9616-4d82-9ba4-394fba606500 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Returning 404 to user: Instance b9e96863-0e05-4ac4-ba31-95db87337440 could not be found. {{(pid=118186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:05:24.076299 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-99a9bdca-9616-4d82-9ba4-394fba606500 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440" status: 404 len: 111 microversion: 2.1 time: 0.029363 Jul 28 04:05:24.076299 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 318/693] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:24 2022] GET /compute/v2.1/servers/b9e96863-0e05-4ac4-ba31-95db87337440 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:05:24.086709 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d4df9ba6-6115-4711-99e7-25d330d45658 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:24.087315 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d4df9ba6-6115-4711-99e7-25d330d45658 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:24.093636 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d4df9ba6-6115-4711-99e7-25d330d45658 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:24.094086 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d4df9ba6-6115-4711-99e7-25d330d45658 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:24.094866 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d4df9ba6-6115-4711-99e7-25d330d45658 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:24.096002 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d4df9ba6-6115-4711-99e7-25d330d45658 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:24.120668 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d4df9ba6-6115-4711-99e7-25d330d45658 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Going to try to terminate instance {{(pid=118187) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:05:24.200981 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d4df9ba6-6115-4711-99e7-25d330d45658 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "DELETE /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 204 len: 0 microversion: 2.1 time: 0.117745 Jul 28 04:05:24.203017 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 376/694] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:05:24 2022] DELETE /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:05:24.213184 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-51a00139-60b0-4304-8470-c1427c553a70 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:24.213798 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-51a00139-60b0-4304-8470-c1427c553a70 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:24.219774 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-51a00139-60b0-4304-8470-c1427c553a70 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:24.220221 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-51a00139-60b0-4304-8470-c1427c553a70 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:24.221858 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-51a00139-60b0-4304-8470-c1427c553a70 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:24.222293 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-51a00139-60b0-4304-8470-c1427c553a70 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:24.436364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b359bdae-4926-41b6-8e20-5f7ea385eb7d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:24.437067 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b359bdae-4926-41b6-8e20-5f7ea385eb7d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:24.443818 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b359bdae-4926-41b6-8e20-5f7ea385eb7d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:24.444267 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b359bdae-4926-41b6-8e20-5f7ea385eb7d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:24.446921 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b359bdae-4926-41b6-8e20-5f7ea385eb7d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:24.446921 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b359bdae-4926-41b6-8e20-5f7ea385eb7d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:24.449146 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-51a00139-60b0-4304-8470-c1427c553a70 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:24.459346 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-51a00139-60b0-4304-8470-c1427c553a70 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.250925 Jul 28 04:05:24.460406 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 319/695] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:24 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:24.591263 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b359bdae-4926-41b6-8e20-5f7ea385eb7d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:24.595021 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:24.600478 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b359bdae-4926-41b6-8e20-5f7ea385eb7d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150" status: 200 len: 1366 microversion: 2.1 time: 0.168361 Jul 28 04:05:24.601059 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 377/696] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:24 2022] GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150 => generated 1366 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:05:25.481429 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-af013715-112f-4f8d-a28b-c78d8175515f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:25.481988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-af013715-112f-4f8d-a28b-c78d8175515f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:25.489520 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-af013715-112f-4f8d-a28b-c78d8175515f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:25.489954 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-af013715-112f-4f8d-a28b-c78d8175515f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:25.490728 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-af013715-112f-4f8d-a28b-c78d8175515f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:25.491198 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-af013715-112f-4f8d-a28b-c78d8175515f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:25.531439 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-54937678-39c0-4b7f-8aaf-68dfafabee77 req-28f74da6-b155-42a7-8d5f-2fcb9cbceb14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d70dec9a-dc79-4378-b2d4-f22ef6956150", "tag": "2c66d8b1-20de-418e-9326-ed59dd9997bb"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:25.555547 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-54937678-39c0-4b7f-8aaf-68dfafabee77 req-28f74da6-b155-42a7-8d5f-2fcb9cbceb14 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:25.556131 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-54937678-39c0-4b7f-8aaf-68dfafabee77 req-28f74da6-b155-42a7-8d5f-2fcb9cbceb14 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:25.575864 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-54937678-39c0-4b7f-8aaf-68dfafabee77 req-28f74da6-b155-42a7-8d5f-2fcb9cbceb14 service nova] Creating event network-changed:2c66d8b1-20de-418e-9326-ed59dd9997bb for instance d70dec9a-dc79-4378-b2d4-f22ef6956150 on hv-cinder-79987 Jul 28 04:05:25.582239 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-54937678-39c0-4b7f-8aaf-68dfafabee77 req-28f74da6-b155-42a7-8d5f-2fcb9cbceb14 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054552 Jul 28 04:05:25.582876 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 378/697] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:05:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:05:25.623516 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a2579f4d-ed58-48d9-8b26-0ffd09db9a1d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:25.624226 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a2579f4d-ed58-48d9-8b26-0ffd09db9a1d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:25.631160 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a2579f4d-ed58-48d9-8b26-0ffd09db9a1d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:25.631614 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a2579f4d-ed58-48d9-8b26-0ffd09db9a1d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:25.632384 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a2579f4d-ed58-48d9-8b26-0ffd09db9a1d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:25.632820 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a2579f4d-ed58-48d9-8b26-0ffd09db9a1d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:25.640013 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-af013715-112f-4f8d-a28b-c78d8175515f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:25.648677 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-af013715-112f-4f8d-a28b-c78d8175515f tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.171209 Jul 28 04:05:25.649268 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 320/698] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:25 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:25.784829 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a2579f4d-ed58-48d9-8b26-0ffd09db9a1d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:25.792547 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a2579f4d-ed58-48d9-8b26-0ffd09db9a1d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150" status: 200 len: 1366 microversion: 2.1 time: 0.174185 Jul 28 04:05:25.793113 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 379/699] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:25 2022] GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150 => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:05:26.671806 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-1e3eabae-687c-4ae0-811e-1edcf7d9d6bb tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:26.672464 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-1e3eabae-687c-4ae0-811e-1edcf7d9d6bb tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:26.679041 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1e3eabae-687c-4ae0-811e-1edcf7d9d6bb tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:26.679500 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1e3eabae-687c-4ae0-811e-1edcf7d9d6bb tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:26.680275 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1e3eabae-687c-4ae0-811e-1edcf7d9d6bb tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:26.680717 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1e3eabae-687c-4ae0-811e-1edcf7d9d6bb tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:26.813639 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a53ac77e-d29a-4efb-b656-5bc0fcb413d4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:26.814957 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a53ac77e-d29a-4efb-b656-5bc0fcb413d4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:26.821676 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a53ac77e-d29a-4efb-b656-5bc0fcb413d4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:26.822131 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a53ac77e-d29a-4efb-b656-5bc0fcb413d4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:26.823169 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a53ac77e-d29a-4efb-b656-5bc0fcb413d4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:26.823613 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a53ac77e-d29a-4efb-b656-5bc0fcb413d4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:26.959744 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a53ac77e-d29a-4efb-b656-5bc0fcb413d4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:26.967409 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a53ac77e-d29a-4efb-b656-5bc0fcb413d4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150" status: 200 len: 1366 microversion: 2.1 time: 0.157758 Jul 28 04:05:26.967988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 380/700] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:26 2022] GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:05:26.984456 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-1e3eabae-687c-4ae0-811e-1edcf7d9d6bb tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:26.992962 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-1e3eabae-687c-4ae0-811e-1edcf7d9d6bb tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1522 microversion: 2.1 time: 0.324977 Jul 28 04:05:26.993544 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 321/701] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:26 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1522 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:27.600154 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-f5e7100b-1069-4469-b153-e25974281bad req-a64bd3b7-5e76-4f43-92bf-405372e3883c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54fdcaaa-031e-4509-b8a7-6b284460c7d2", "name": "network-vif-deleted", "tag": "a3fa56f4-0f47-422c-8d08-1b8073aa9acc"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:27.609842 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-f5e7100b-1069-4469-b153-e25974281bad req-a64bd3b7-5e76-4f43-92bf-405372e3883c service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:27.610283 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-f5e7100b-1069-4469-b153-e25974281bad req-a64bd3b7-5e76-4f43-92bf-405372e3883c service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:27.622405 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-f5e7100b-1069-4469-b153-e25974281bad req-a64bd3b7-5e76-4f43-92bf-405372e3883c service nova] Creating event network-vif-deleted:a3fa56f4-0f47-422c-8d08-1b8073aa9acc for instance 54fdcaaa-031e-4509-b8a7-6b284460c7d2 on hv-cinder-79987 Jul 28 04:05:27.627498 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-f5e7100b-1069-4469-b153-e25974281bad req-a64bd3b7-5e76-4f43-92bf-405372e3883c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030973 Jul 28 04:05:27.628117 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 381/702] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:27.988244 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-f1a2967a-5e03-42c6-b884-7eabe7a47f84 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:27.988770 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-f1a2967a-5e03-42c6-b884-7eabe7a47f84 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:27.995329 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f1a2967a-5e03-42c6-b884-7eabe7a47f84 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:27.995786 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f1a2967a-5e03-42c6-b884-7eabe7a47f84 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:27.996587 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f1a2967a-5e03-42c6-b884-7eabe7a47f84 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:27.997025 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f1a2967a-5e03-42c6-b884-7eabe7a47f84 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:28.014540 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e594b354-e646-43b6-a1c7-099ddd9e6ad9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:28.015396 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e594b354-e646-43b6-a1c7-099ddd9e6ad9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:28.022200 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e594b354-e646-43b6-a1c7-099ddd9e6ad9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:28.022729 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e594b354-e646-43b6-a1c7-099ddd9e6ad9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:28.024003 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e594b354-e646-43b6-a1c7-099ddd9e6ad9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:28.024518 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e594b354-e646-43b6-a1c7-099ddd9e6ad9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:28.093778 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e594b354-e646-43b6-a1c7-099ddd9e6ad9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '72dbbd19e4454bee84fe5bc797497bd0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6ca5212b1a1743f2910407d7b8ba7aaf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:28.102393 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e594b354-e646-43b6-a1c7-099ddd9e6ad9 tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 200 len: 1306 microversion: 2.1 time: 0.092464 Jul 28 04:05:28.102998 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 382/703] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:28 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 1306 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:28.141151 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-f1a2967a-5e03-42c6-b884-7eabe7a47f84 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:28.149345 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-f1a2967a-5e03-42c6-b884-7eabe7a47f84 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150" status: 200 len: 1366 microversion: 2.1 time: 0.165587 Jul 28 04:05:28.149908 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 322/704] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:27 2022] GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:29.122987 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-73636705-037e-48b0-b21c-7b9e9892a10b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:29.123601 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-73636705-037e-48b0-b21c-7b9e9892a10b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] [instance: 54fdcaaa-031e-4509-b8a7-6b284460c7d2] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:29.130669 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-73636705-037e-48b0-b21c-7b9e9892a10b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:29.131149 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-73636705-037e-48b0-b21c-7b9e9892a10b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:29.131907 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-73636705-037e-48b0-b21c-7b9e9892a10b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:29.132342 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-73636705-037e-48b0-b21c-7b9e9892a10b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:29.145997 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-73636705-037e-48b0-b21c-7b9e9892a10b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] HTTP exception thrown: Instance 54fdcaaa-031e-4509-b8a7-6b284460c7d2 could not be found. Jul 28 04:05:29.147627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-73636705-037e-48b0-b21c-7b9e9892a10b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Request method failure captured: Jul 28 04:05:29.147627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 HTTP/1.1 Jul 28 04:05:29.147627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:05:29.147627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:05:29.147627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:05:29.147627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:05:29.147627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:05:29.147627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:05:29.147627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:05:29.147627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:05:29.147627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gmx9saU6X6wXaut0oV-DgXC4eOrOdUPDpTL-be51IOCob459Vnx3p8cEv5I-817MPvea-z5B1wjBZmkZVFZyS4Z5HE0xs4B5dv5vHGJrJ18ZwqUg2jQyx-xGnyCE7MhhFmKrX3UvKtRA53M9fiu3ycBzv2wFrj6Q7c0TYYzfm06pvY Jul 28 04:05:29.147627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:05:29.147627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:05:29.147627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:05:29.147627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:05:29.147627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:05:29.147627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:05:29.147627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 6ca5212b1a1743f2910407d7b8ba7aaf Jul 28 04:05:29.147627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1523098003 Jul 28 04:05:29.147627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:05:29.147627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:05:29.149212 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_6ca5212b1a1743f2910407d7b8ba7aaf", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ca5212b1a1743f2910407d7b8ba7aaf"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/6ca5212b1a1743f2910407d7b8ba7aaf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/6ca5212b1a1743f2910407d7b8ba7aaf"}]}] Jul 28 04:05:29.149212 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1523098003 Jul 28 04:05:29.149212 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 6ca5212b1a1743f2910407d7b8ba7aaf Jul 28 04:05:29.149212 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1523098003 Jul 28 04:05:29.149212 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-ServerRescueNegativeTestJSON-1523098003-project Jul 28 04:05:29.149212 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:05:29.149212 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:05:29.149212 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: 72dbbd19e4454bee84fe5bc797497bd0 Jul 28 04:05:29.149212 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1523098003-project Jul 28 04:05:29.149212 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:05:29.149212 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Instance 54fdcaaa-031e-4509-b8a7-6b284460c7d2 could not be found. Jul 28 04:05:29.149212 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': '54fdcaaa-031e-4509-b8a7-6b284460c7d2'} Jul 28 04:05:29.150015 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:05:29.150015 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:29.150015 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:05:29.150015 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:05:29.150015 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:05:29.150015 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:05:29.150015 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:05:29.150015 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:05:29.150015 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:05:29.150015 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:05:29.150015 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54fdcaaa-031e-4509-b8a7-6b284460c7d2 could not be found. Jul 28 04:05:29.150015 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:05:29.150015 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:29.150015 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:05:29.150015 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:29.150015 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:29.150015 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:29.150015 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:05:29.150015 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:05:29.150015 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:05:29.151251 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:05:29.151251 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:05:29.151251 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:05:29.151251 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:05:29.151251 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:05:29.151251 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:05:29.151251 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:05:29.151251 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54fdcaaa-031e-4509-b8a7-6b284460c7d2 could not be found. Jul 28 04:05:29.151251 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:05:29.151251 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:05:29.151251 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:05:29.151251 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:05:29.151251 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:05:29.151251 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:05:29.151251 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:05:29.151251 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:05:29.151251 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54fdcaaa-031e-4509-b8a7-6b284460c7d2 could not be found. Jul 28 04:05:29.151251 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:05:29.152387 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-73636705-037e-48b0-b21c-7b9e9892a10b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] Returning 404 to user: Instance 54fdcaaa-031e-4509-b8a7-6b284460c7d2 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:05:29.152387 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-73636705-037e-48b0-b21c-7b9e9892a10b tempest-ServerRescueNegativeTestJSON-1523098003 tempest-ServerRescueNegativeTestJSON-1523098003-project] 10.222.0.46 "GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2" status: 404 len: 111 microversion: 2.1 time: 0.029921 Jul 28 04:05:29.152387 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 383/705] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:29 2022] GET /compute/v2.1/servers/54fdcaaa-031e-4509-b8a7-6b284460c7d2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:05:29.170597 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-b6e84a9c-3c70-4ecb-9861-a5859eadc2ea tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:29.171312 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-b6e84a9c-3c70-4ecb-9861-a5859eadc2ea tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:29.178555 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b6e84a9c-3c70-4ecb-9861-a5859eadc2ea tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:29.179038 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b6e84a9c-3c70-4ecb-9861-a5859eadc2ea tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:29.179803 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b6e84a9c-3c70-4ecb-9861-a5859eadc2ea tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:29.180241 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b6e84a9c-3c70-4ecb-9861-a5859eadc2ea tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:29.308391 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-b6e84a9c-3c70-4ecb-9861-a5859eadc2ea tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:29.316938 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-b6e84a9c-3c70-4ecb-9861-a5859eadc2ea tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150" status: 200 len: 1366 microversion: 2.1 time: 0.150204 Jul 28 04:05:29.317524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 323/706] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:29 2022] GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:30.337457 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d7ea0a92-7baa-4215-8fba-06bd741057f1 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:30.338074 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d7ea0a92-7baa-4215-8fba-06bd741057f1 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:30.340092 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=6 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:30.348486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d7ea0a92-7baa-4215-8fba-06bd741057f1 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:30.348934 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d7ea0a92-7baa-4215-8fba-06bd741057f1 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:30.350252 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d7ea0a92-7baa-4215-8fba-06bd741057f1 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:30.350714 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d7ea0a92-7baa-4215-8fba-06bd741057f1 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:30.560415 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d7ea0a92-7baa-4215-8fba-06bd741057f1 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:30.568925 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d7ea0a92-7baa-4215-8fba-06bd741057f1 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150" status: 200 len: 1366 microversion: 2.1 time: 0.235216 Jul 28 04:05:30.569591 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 384/707] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:30 2022] GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150 => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:31.591484 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-6b4ae088-8605-42cc-b790-5c6c877562b4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:31.592487 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-6b4ae088-8605-42cc-b790-5c6c877562b4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:31.594668 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell0:SELECT=2 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:31.595485 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell0:SELECT=6 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:31.602822 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6b4ae088-8605-42cc-b790-5c6c877562b4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:31.603297 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6b4ae088-8605-42cc-b790-5c6c877562b4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:31.604063 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6b4ae088-8605-42cc-b790-5c6c877562b4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:31.604494 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6b4ae088-8605-42cc-b790-5c6c877562b4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:31.608767 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:31.758108 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-6b4ae088-8605-42cc-b790-5c6c877562b4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:31.766239 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-6b4ae088-8605-42cc-b790-5c6c877562b4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150" status: 200 len: 1366 microversion: 2.1 time: 0.179234 Jul 28 04:05:31.784515 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 324/708] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:31 2022] GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150 => generated 1366 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:31.863578 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-6d418278-5c8b-41df-8b3c-a0dddec2e781 req-6c53d93f-e7e0-4bc2-a101-ad5620697f2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d70dec9a-dc79-4378-b2d4-f22ef6956150", "name": "network-vif-plugged", "status": "completed", "tag": "2c66d8b1-20de-418e-9326-ed59dd9997bb"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:31.873527 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-6d418278-5c8b-41df-8b3c-a0dddec2e781 req-6c53d93f-e7e0-4bc2-a101-ad5620697f2f service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:31.873979 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-6d418278-5c8b-41df-8b3c-a0dddec2e781 req-6c53d93f-e7e0-4bc2-a101-ad5620697f2f service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:31.885819 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-6d418278-5c8b-41df-8b3c-a0dddec2e781 req-6c53d93f-e7e0-4bc2-a101-ad5620697f2f service nova] Creating event network-vif-plugged:2c66d8b1-20de-418e-9326-ed59dd9997bb for instance d70dec9a-dc79-4378-b2d4-f22ef6956150 on hv-cinder-79987 Jul 28 04:05:31.890671 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-6d418278-5c8b-41df-8b3c-a0dddec2e781 req-6c53d93f-e7e0-4bc2-a101-ad5620697f2f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.129038 Jul 28 04:05:31.891386 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 385/709] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:05:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:05:32.790375 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-eadd263d-0141-46e3-9fed-46fce680e007 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:32.791047 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-eadd263d-0141-46e3-9fed-46fce680e007 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:32.797615 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-eadd263d-0141-46e3-9fed-46fce680e007 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:32.798023 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-eadd263d-0141-46e3-9fed-46fce680e007 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:32.799402 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-eadd263d-0141-46e3-9fed-46fce680e007 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:32.799831 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-eadd263d-0141-46e3-9fed-46fce680e007 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:32.989977 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-eadd263d-0141-46e3-9fed-46fce680e007 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:32.997697 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-eadd263d-0141-46e3-9fed-46fce680e007 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150" status: 200 len: 1366 microversion: 2.1 time: 0.211447 Jul 28 04:05:32.998276 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 325/710] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:32 2022] GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150 => generated 1366 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:05:34.023222 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b88792c7-18cc-474e-9ddc-dfaa0bbfa98e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:34.023938 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b88792c7-18cc-474e-9ddc-dfaa0bbfa98e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:34.030660 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b88792c7-18cc-474e-9ddc-dfaa0bbfa98e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:34.031192 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b88792c7-18cc-474e-9ddc-dfaa0bbfa98e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:34.032133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b88792c7-18cc-474e-9ddc-dfaa0bbfa98e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:34.033247 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b88792c7-18cc-474e-9ddc-dfaa0bbfa98e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:34.240605 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b88792c7-18cc-474e-9ddc-dfaa0bbfa98e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:34.249205 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b88792c7-18cc-474e-9ddc-dfaa0bbfa98e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150" status: 200 len: 1555 microversion: 2.1 time: 0.231237 Jul 28 04:05:34.249792 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 386/711] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:05:34 2022] GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150 => generated 1555 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:05:34.271841 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-d9c1a6f3-bfef-4702-b3cd-4f370803cf2e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:34.272426 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-d9c1a6f3-bfef-4702-b3cd-4f370803cf2e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:34.279801 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d9c1a6f3-bfef-4702-b3cd-4f370803cf2e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:34.280331 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d9c1a6f3-bfef-4702-b3cd-4f370803cf2e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:34.281160 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d9c1a6f3-bfef-4702-b3cd-4f370803cf2e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:34.281661 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d9c1a6f3-bfef-4702-b3cd-4f370803cf2e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:34.363099 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-d9c1a6f3-bfef-4702-b3cd-4f370803cf2e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095350 Jul 28 04:05:34.363991 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 326/712] 10.222.0.46 () {58 vars in 1275 bytes} [Thu Jul 28 04:05:34 2022] GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:35.973397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-bbc6f5a4-e7c4-4c99-beb5-b87f34003ca7 req-c108b837-0b52-4d30-b2fc-390f1bc0b97f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d70dec9a-dc79-4378-b2d4-f22ef6956150", "tag": "2c66d8b1-20de-418e-9326-ed59dd9997bb"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:35.991411 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-bbc6f5a4-e7c4-4c99-beb5-b87f34003ca7 req-c108b837-0b52-4d30-b2fc-390f1bc0b97f service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:35.991863 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-bbc6f5a4-e7c4-4c99-beb5-b87f34003ca7 req-c108b837-0b52-4d30-b2fc-390f1bc0b97f service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:36.011603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-bbc6f5a4-e7c4-4c99-beb5-b87f34003ca7 req-c108b837-0b52-4d30-b2fc-390f1bc0b97f service nova] Creating event network-changed:2c66d8b1-20de-418e-9326-ed59dd9997bb for instance d70dec9a-dc79-4378-b2d4-f22ef6956150 on hv-cinder-79987 Jul 28 04:05:36.017731 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-bbc6f5a4-e7c4-4c99-beb5-b87f34003ca7 req-c108b837-0b52-4d30-b2fc-390f1bc0b97f service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047384 Jul 28 04:05:36.019166 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 387/713] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:05:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:38.518538 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-948cab88-65c5-4c7a-849f-8c9427742ce4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Action: 'create', calling method: .version_select at 0x7fa6ee0a0e50>, body: {"keypair": {"name": "tempest-keypair-1253939240", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHCC0qlwXrCGjAZZAvIrFyOEdfLfcd8LJ3yOa5swwDpcW0Fz7HmYmjskPxSHwRLvsQ42NpEj/c/iwjGeq8pZ+xrOECQU+J4SzK5UN21RAy2GnW34zvMbFCAkvQbOaxX6xA=="}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:38.534988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-948cab88-65c5-4c7a-849f-8c9427742ce4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Getting quotas for project 901cf93dff224196b6727a29f0038bdb. Resources: {'key_pairs'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:05:38.539281 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-948cab88-65c5-4c7a-849f-8c9427742ce4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Getting quotas for user b7e6ceb0f76d41ce962efd065ffa3d5a and project 901cf93dff224196b6727a29f0038bdb. Resources: {'key_pairs'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:05:38.561983 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-948cab88-65c5-4c7a-849f-8c9427742ce4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.178315 Jul 28 04:05:38.562595 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 327/714] 10.222.0.46 () {62 vars in 1200 bytes} [Thu Jul 28 04:05:38 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 180 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 04:05:39.857748 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-17bb62ad-140a-444f-a57e-628a4dea00b4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1792864765", "imageRef": "a0eec51c-83e9-420b-bcb9-20fe8dcf5321", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24a1a4ba-e12a-48fd-9c17-f0ddc850f27d"}], "security_groups": [{"name": "tempest-securitygroup--1118969209"}], "key_name": "tempest-keypair-1253939240", "user_data": "}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:39.964043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.network.neutron [None req-17bb62ad-140a-444f-a57e-628a4dea00b4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] validate_networks() for [('24a1a4ba-e12a-48fd-9c17-f0ddc850f27d', None, None, None, None, None)] {{(pid=118187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:05:40.355568 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-17bb62ad-140a-444f-a57e-628a4dea00b4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Flavor limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:05:40.356124 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-17bb62ad-140a-444f-a57e-628a4dea00b4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Image limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:05:40.356679 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-17bb62ad-140a-444f-a57e-628a4dea00b4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Flavor pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:05:40.358309 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-17bb62ad-140a-444f-a57e-628a4dea00b4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Image pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:05:40.358738 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-17bb62ad-140a-444f-a57e-628a4dea00b4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:05:40.368986 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-17bb62ad-140a-444f-a57e-628a4dea00b4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:40.369445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-17bb62ad-140a-444f-a57e-628a4dea00b4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:40.370246 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-17bb62ad-140a-444f-a57e-628a4dea00b4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:40.370685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-17bb62ad-140a-444f-a57e-628a4dea00b4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:40.389947 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-17bb62ad-140a-444f-a57e-628a4dea00b4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Getting quotas for project 901cf93dff224196b6727a29f0038bdb. Resources: {'instances', 'cores', 'ram'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:05:40.394366 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-17bb62ad-140a-444f-a57e-628a4dea00b4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Getting quotas for user b7e6ceb0f76d41ce962efd065ffa3d5a and project 901cf93dff224196b6727a29f0038bdb. Resources: {'instances', 'cores', 'ram'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:05:40.406547 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-17bb62ad-140a-444f-a57e-628a4dea00b4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Going to run 1 instances... {{(pid=118187) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:05:40.409884 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-17bb62ad-140a-444f-a57e-628a4dea00b4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0eec51c-83e9-420b-bcb9-20fe8dcf5321',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:05:40.473800 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-17bb62ad-140a-444f-a57e-628a4dea00b4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.620596 Jul 28 04:05:40.481074 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 388/715] 10.222.0.46 () {62 vars in 1188 bytes} [Thu Jul 28 04:05:39 2022] POST /compute/v2.1/servers => generated 402 bytes in 628 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 28 04:05:40.486572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-59075d8a-7684-46ee-8993-e3efdaa97e3c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:40.487226 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-59075d8a-7684-46ee-8993-e3efdaa97e3c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:40.601590 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-59075d8a-7684-46ee-8993-e3efdaa97e3c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:40.616026 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-59075d8a-7684-46ee-8993-e3efdaa97e3c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:40.617844 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-59075d8a-7684-46ee-8993-e3efdaa97e3c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:40.619653 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-59075d8a-7684-46ee-8993-e3efdaa97e3c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1282 microversion: 2.20 time: 0.137652 Jul 28 04:05:40.621148 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 328/716] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:40 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1282 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:05:41.645714 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-215311ee-f23f-4dde-9399-2eefc9b7c7cb tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:41.646405 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-215311ee-f23f-4dde-9399-2eefc9b7c7cb tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:41.654154 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-215311ee-f23f-4dde-9399-2eefc9b7c7cb tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:41.654690 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-215311ee-f23f-4dde-9399-2eefc9b7c7cb tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:41.655563 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-215311ee-f23f-4dde-9399-2eefc9b7c7cb tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:41.656064 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-215311ee-f23f-4dde-9399-2eefc9b7c7cb tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:41.748254 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-215311ee-f23f-4dde-9399-2eefc9b7c7cb tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:41.759053 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-215311ee-f23f-4dde-9399-2eefc9b7c7cb tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:41.761749 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-215311ee-f23f-4dde-9399-2eefc9b7c7cb tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:41.764559 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-215311ee-f23f-4dde-9399-2eefc9b7c7cb tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1342 microversion: 2.20 time: 0.122959 Jul 28 04:05:41.765293 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 389/717] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:41 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1342 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:05:42.759143 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-17e73b14-5727-4f8e-bff2-cc3262513758 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:42.759534 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-17e73b14-5727-4f8e-bff2-cc3262513758 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:42.766958 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-17e73b14-5727-4f8e-bff2-cc3262513758 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:42.767665 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-17e73b14-5727-4f8e-bff2-cc3262513758 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:42.768538 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-17e73b14-5727-4f8e-bff2-cc3262513758 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:42.768977 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-17e73b14-5727-4f8e-bff2-cc3262513758 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:42.791133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7f25fca7-22c0-481d-88f5-bb7a447a3bfd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:42.791949 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7f25fca7-22c0-481d-88f5-bb7a447a3bfd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:42.795131 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-17e73b14-5727-4f8e-bff2-cc3262513758 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53/ips" status: 200 len: 146 microversion: 2.1 time: 0.040286 Jul 28 04:05:42.795801 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 329/718] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Jul 28 04:05:42 2022] GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53/ips => generated 146 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:42.800783 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7f25fca7-22c0-481d-88f5-bb7a447a3bfd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:42.802082 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7f25fca7-22c0-481d-88f5-bb7a447a3bfd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:42.803214 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7f25fca7-22c0-481d-88f5-bb7a447a3bfd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:42.803783 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7f25fca7-22c0-481d-88f5-bb7a447a3bfd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:43.004852 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7f25fca7-22c0-481d-88f5-bb7a447a3bfd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:43.015979 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7f25fca7-22c0-481d-88f5-bb7a447a3bfd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:43.019832 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7f25fca7-22c0-481d-88f5-bb7a447a3bfd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:43.021005 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7f25fca7-22c0-481d-88f5-bb7a447a3bfd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1408 microversion: 2.20 time: 0.236897 Jul 28 04:05:43.031284 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 390/719] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:42 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1408 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:05:43.096193 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-272a176e-e1f4-4dc2-be15-e8d2d23e0d18 req-31ab31bb-d39c-4185-a02a-4793348df93d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "489708ab-f8bf-4f93-aa7a-907559b15d01", "tag": "0e9bfde3-9675-4314-9b59-4d7ba4f8ddf3"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:43.109650 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-272a176e-e1f4-4dc2-be15-e8d2d23e0d18 req-31ab31bb-d39c-4185-a02a-4793348df93d service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:43.110439 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-272a176e-e1f4-4dc2-be15-e8d2d23e0d18 req-31ab31bb-d39c-4185-a02a-4793348df93d service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:43.132751 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-272a176e-e1f4-4dc2-be15-e8d2d23e0d18 req-31ab31bb-d39c-4185-a02a-4793348df93d service nova] Creating event network-changed:0e9bfde3-9675-4314-9b59-4d7ba4f8ddf3 for instance 489708ab-f8bf-4f93-aa7a-907559b15d01 on hv-cinder-79987 Jul 28 04:05:43.143742 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-272a176e-e1f4-4dc2-be15-e8d2d23e0d18 req-31ab31bb-d39c-4185-a02a-4793348df93d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052773 Jul 28 04:05:43.145789 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 330/720] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:44.046621 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3299100c-969f-4f30-ac96-009728f976d7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:44.047254 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3299100c-969f-4f30-ac96-009728f976d7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:44.054182 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3299100c-969f-4f30-ac96-009728f976d7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:44.054640 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3299100c-969f-4f30-ac96-009728f976d7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:44.055450 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3299100c-969f-4f30-ac96-009728f976d7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:44.055897 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3299100c-969f-4f30-ac96-009728f976d7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:44.181667 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3299100c-969f-4f30-ac96-009728f976d7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:44.189876 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3299100c-969f-4f30-ac96-009728f976d7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:44.191427 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3299100c-969f-4f30-ac96-009728f976d7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:44.192541 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3299100c-969f-4f30-ac96-009728f976d7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1408 microversion: 2.20 time: 0.149821 Jul 28 04:05:44.193106 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 391/721] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:44 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1408 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:05:44.382430 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-72697af7-a0f6-4f37-8875-b6297fffb6e7 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7cf91b2c-2690-4e7c-8c38-653864e620cb"}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:44.384862 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-72697af7-a0f6-4f37-8875-b6297fffb6e7 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:44.392125 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-72697af7-a0f6-4f37-8875-b6297fffb6e7 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:44.392584 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-72697af7-a0f6-4f37-8875-b6297fffb6e7 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:44.393343 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-72697af7-a0f6-4f37-8875-b6297fffb6e7 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:44.393784 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-72697af7-a0f6-4f37-8875-b6297fffb6e7 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:44.723781 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-72697af7-a0f6-4f37-8875-b6297fffb6e7 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "POST /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.345298 Jul 28 04:05:44.724647 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 331/722] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Jul 28 04:05:44 2022] POST /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53/os-volume_attachments => generated 194 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:45.215096 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-058f5339-27c8-42c6-a5bc-3410c44394c0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:45.215709 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-058f5339-27c8-42c6-a5bc-3410c44394c0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:45.223003 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-058f5339-27c8-42c6-a5bc-3410c44394c0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:45.223457 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-058f5339-27c8-42c6-a5bc-3410c44394c0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:45.224220 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-058f5339-27c8-42c6-a5bc-3410c44394c0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:45.224661 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-058f5339-27c8-42c6-a5bc-3410c44394c0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:45.362637 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-058f5339-27c8-42c6-a5bc-3410c44394c0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:45.373548 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-058f5339-27c8-42c6-a5bc-3410c44394c0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:45.375073 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-058f5339-27c8-42c6-a5bc-3410c44394c0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:45.376416 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-058f5339-27c8-42c6-a5bc-3410c44394c0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1408 microversion: 2.20 time: 0.165121 Jul 28 04:05:45.376968 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 392/723] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:45 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1408 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:05:46.399096 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-403e2995-205c-4d63-a704-f45a9ab82fe7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:46.399775 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-403e2995-205c-4d63-a704-f45a9ab82fe7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:46.406447 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-403e2995-205c-4d63-a704-f45a9ab82fe7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:46.407488 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-403e2995-205c-4d63-a704-f45a9ab82fe7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:46.408468 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-403e2995-205c-4d63-a704-f45a9ab82fe7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:46.408900 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-403e2995-205c-4d63-a704-f45a9ab82fe7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:46.543304 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-403e2995-205c-4d63-a704-f45a9ab82fe7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:46.551260 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-403e2995-205c-4d63-a704-f45a9ab82fe7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:46.552789 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-403e2995-205c-4d63-a704-f45a9ab82fe7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:46.553912 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-403e2995-205c-4d63-a704-f45a9ab82fe7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1408 microversion: 2.20 time: 0.159164 Jul 28 04:05:46.554485 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 332/724] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:46 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:05:47.576585 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-0aebb5ff-ed55-42df-a717-e814fa2e5713 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:47.577209 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-0aebb5ff-ed55-42df-a717-e814fa2e5713 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:47.579627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:47.584815 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0aebb5ff-ed55-42df-a717-e814fa2e5713 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:47.585267 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0aebb5ff-ed55-42df-a717-e814fa2e5713 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:47.586033 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0aebb5ff-ed55-42df-a717-e814fa2e5713 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:47.586475 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0aebb5ff-ed55-42df-a717-e814fa2e5713 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:47.715042 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-0aebb5ff-ed55-42df-a717-e814fa2e5713 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:47.723634 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-0aebb5ff-ed55-42df-a717-e814fa2e5713 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:47.725161 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-0aebb5ff-ed55-42df-a717-e814fa2e5713 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:47.726278 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-0aebb5ff-ed55-42df-a717-e814fa2e5713 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1408 microversion: 2.20 time: 0.153672 Jul 28 04:05:47.726855 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 393/725] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:47 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1408 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:05:48.749559 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-9f2e29d7-f11f-4add-87d8-91bb1ae0f3de tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:48.750105 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-9f2e29d7-f11f-4add-87d8-91bb1ae0f3de tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:48.757142 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9f2e29d7-f11f-4add-87d8-91bb1ae0f3de tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:48.757614 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9f2e29d7-f11f-4add-87d8-91bb1ae0f3de tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:48.758369 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9f2e29d7-f11f-4add-87d8-91bb1ae0f3de tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:48.758824 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9f2e29d7-f11f-4add-87d8-91bb1ae0f3de tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:48.886275 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-9f2e29d7-f11f-4add-87d8-91bb1ae0f3de tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:48.895607 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-9f2e29d7-f11f-4add-87d8-91bb1ae0f3de tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:48.897079 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-9f2e29d7-f11f-4add-87d8-91bb1ae0f3de tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:48.898170 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-9f2e29d7-f11f-4add-87d8-91bb1ae0f3de tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1408 microversion: 2.20 time: 0.152611 Jul 28 04:05:48.898728 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 333/726] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:48 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1408 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:05:49.840472 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-a4138a76-7f30-4135-a955-ad82efe6626b req-fee577d5-c9c6-4ee1-9fc9-aea8878f0629 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "489708ab-f8bf-4f93-aa7a-907559b15d01", "name": "network-vif-plugged", "status": "completed", "tag": "0e9bfde3-9675-4314-9b59-4d7ba4f8ddf3"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:49.852816 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-a4138a76-7f30-4135-a955-ad82efe6626b req-fee577d5-c9c6-4ee1-9fc9-aea8878f0629 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:49.853446 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-a4138a76-7f30-4135-a955-ad82efe6626b req-fee577d5-c9c6-4ee1-9fc9-aea8878f0629 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:49.868005 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-a4138a76-7f30-4135-a955-ad82efe6626b req-fee577d5-c9c6-4ee1-9fc9-aea8878f0629 service nova] Creating event network-vif-plugged:0e9bfde3-9675-4314-9b59-4d7ba4f8ddf3 for instance 489708ab-f8bf-4f93-aa7a-907559b15d01 on hv-cinder-79987 Jul 28 04:05:49.872937 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-a4138a76-7f30-4135-a955-ad82efe6626b req-fee577d5-c9c6-4ee1-9fc9-aea8878f0629 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036127 Jul 28 04:05:49.873692 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 394/727] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:49.921566 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-d63d5b48-0a78-4126-8865-449db42dd837 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:49.923767 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-d63d5b48-0a78-4126-8865-449db42dd837 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:49.926171 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:49.932511 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d63d5b48-0a78-4126-8865-449db42dd837 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:49.932960 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d63d5b48-0a78-4126-8865-449db42dd837 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:49.933727 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d63d5b48-0a78-4126-8865-449db42dd837 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:49.934163 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d63d5b48-0a78-4126-8865-449db42dd837 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:50.115547 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-d63d5b48-0a78-4126-8865-449db42dd837 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:50.123431 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-d63d5b48-0a78-4126-8865-449db42dd837 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:50.124929 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-d63d5b48-0a78-4126-8865-449db42dd837 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:50.126624 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-d63d5b48-0a78-4126-8865-449db42dd837 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1408 microversion: 2.20 time: 0.209014 Jul 28 04:05:50.127434 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 334/728] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:49 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:05:51.149276 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4c71e7a0-46cc-4fc9-97e6-d55fbf2c7406 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:51.149972 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-4c71e7a0-46cc-4fc9-97e6-d55fbf2c7406 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:51.151944 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:51.152588 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=6 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:51.159402 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4c71e7a0-46cc-4fc9-97e6-d55fbf2c7406 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:51.159853 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4c71e7a0-46cc-4fc9-97e6-d55fbf2c7406 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:51.160654 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4c71e7a0-46cc-4fc9-97e6-d55fbf2c7406 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:51.161097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4c71e7a0-46cc-4fc9-97e6-d55fbf2c7406 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:51.294024 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4c71e7a0-46cc-4fc9-97e6-d55fbf2c7406 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:51.302038 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4c71e7a0-46cc-4fc9-97e6-d55fbf2c7406 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:51.303583 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4c71e7a0-46cc-4fc9-97e6-d55fbf2c7406 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:51.304696 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4c71e7a0-46cc-4fc9-97e6-d55fbf2c7406 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1408 microversion: 2.20 time: 0.159895 Jul 28 04:05:51.305283 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 395/729] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:51 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:05:52.245672 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-208676c9-2fcb-4077-8526-ad430c849ed8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:52.247921 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-208676c9-2fcb-4077-8526-ad430c849ed8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:52.249768 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell0:SELECT=6 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:52.256362 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-208676c9-2fcb-4077-8526-ad430c849ed8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:52.256817 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-208676c9-2fcb-4077-8526-ad430c849ed8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:52.257583 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-208676c9-2fcb-4077-8526-ad430c849ed8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:52.258021 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-208676c9-2fcb-4077-8526-ad430c849ed8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:52.288125 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-208676c9-2fcb-4077-8526-ad430c849ed8 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046349 Jul 28 04:05:52.288670 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 335/730] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Jul 28 04:05:52 2022] GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:52.299803 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b8b72a8e-37d1-429a-a27e-79316f2e3f78 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:52.300301 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b8b72a8e-37d1-429a-a27e-79316f2e3f78 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:52.306689 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b8b72a8e-37d1-429a-a27e-79316f2e3f78 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:52.307171 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b8b72a8e-37d1-429a-a27e-79316f2e3f78 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:52.307939 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b8b72a8e-37d1-429a-a27e-79316f2e3f78 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:52.308420 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b8b72a8e-37d1-429a-a27e-79316f2e3f78 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:52.327353 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-2aebedfb-7a72-4b3e-9090-821258669fc0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:52.327974 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-2aebedfb-7a72-4b3e-9090-821258669fc0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:52.334235 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2aebedfb-7a72-4b3e-9090-821258669fc0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:52.337853 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b8b72a8e-37d1-429a-a27e-79316f2e3f78 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53/os-volume_attachments/7cf91b2c-2690-4e7c-8c38-653864e620cb" status: 200 len: 194 microversion: 2.1 time: 0.042585 Jul 28 04:05:52.338450 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 396/731] 10.222.0.46 () {58 vars in 1413 bytes} [Thu Jul 28 04:05:52 2022] GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53/os-volume_attachments/7cf91b2c-2690-4e7c-8c38-653864e620cb => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:52.340306 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2aebedfb-7a72-4b3e-9090-821258669fc0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:52.341622 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2aebedfb-7a72-4b3e-9090-821258669fc0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:52.342075 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2aebedfb-7a72-4b3e-9090-821258669fc0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:52.480535 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-2aebedfb-7a72-4b3e-9090-821258669fc0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:52.489162 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-2aebedfb-7a72-4b3e-9090-821258669fc0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:52.492333 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-2aebedfb-7a72-4b3e-9090-821258669fc0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:05:52.492333 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-2aebedfb-7a72-4b3e-9090-821258669fc0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1600 microversion: 2.20 time: 0.168468 Jul 28 04:05:52.507186 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 336/732] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:05:52 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1600 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:05:52.514287 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-cd505e0d-3330-4031-9b34-e5083cd8c42d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:05:52.514804 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-cd505e0d-3330-4031-9b34-e5083cd8c42d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:52.521401 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cd505e0d-3330-4031-9b34-e5083cd8c42d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:52.521862 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cd505e0d-3330-4031-9b34-e5083cd8c42d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:52.522628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cd505e0d-3330-4031-9b34-e5083cd8c42d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:52.523107 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-cd505e0d-3330-4031-9b34-e5083cd8c42d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:52.607512 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-cd505e0d-3330-4031-9b34-e5083cd8c42d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095999 Jul 28 04:05:52.608444 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 397/733] 10.222.0.46 () {60 vars in 1316 bytes} [Thu Jul 28 04:05:52 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:05:53.524661 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-21b91008-2f05-46ed-8912-79a6f3f5e1f1 req-84e78ae1-d764-4586-8813-a92d8214d138 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "489708ab-f8bf-4f93-aa7a-907559b15d01", "tag": "0e9bfde3-9675-4314-9b59-4d7ba4f8ddf3"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:53.535587 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-21b91008-2f05-46ed-8912-79a6f3f5e1f1 req-84e78ae1-d764-4586-8813-a92d8214d138 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:53.536117 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-21b91008-2f05-46ed-8912-79a6f3f5e1f1 req-84e78ae1-d764-4586-8813-a92d8214d138 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:53.547873 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-21b91008-2f05-46ed-8912-79a6f3f5e1f1 req-84e78ae1-d764-4586-8813-a92d8214d138 service nova] Creating event network-changed:0e9bfde3-9675-4314-9b59-4d7ba4f8ddf3 for instance 489708ab-f8bf-4f93-aa7a-907559b15d01 on hv-cinder-79987 Jul 28 04:05:53.553299 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-21b91008-2f05-46ed-8912-79a6f3f5e1f1 req-84e78ae1-d764-4586-8813-a92d8214d138 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032099 Jul 28 04:05:53.554511 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 337/734] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:05:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:05:53.708836 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ccbacb94-071d-4009-8d78-8ad1da45731b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4334cbf7-278c-42c2-84fa-d5f109ffd951"}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:05:53.712024 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ccbacb94-071d-4009-8d78-8ad1da45731b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:05:53.719619 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ccbacb94-071d-4009-8d78-8ad1da45731b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:53.720485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ccbacb94-071d-4009-8d78-8ad1da45731b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:53.721642 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ccbacb94-071d-4009-8d78-8ad1da45731b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:05:53.722157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ccbacb94-071d-4009-8d78-8ad1da45731b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:05:53.988219 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:05:54.012337 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ccbacb94-071d-4009-8d78-8ad1da45731b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "POST /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307115 Jul 28 04:05:54.013753 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 398/735] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Jul 28 04:05:53 2022] POST /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53/os-volume_attachments => generated 194 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:01.544536 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-dc0fa905-4f8a-4853-8260-41eb9fa854ed tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:01.546747 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-dc0fa905-4f8a-4853-8260-41eb9fa854ed tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:01.553705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dc0fa905-4f8a-4853-8260-41eb9fa854ed tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:01.554163 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dc0fa905-4f8a-4853-8260-41eb9fa854ed tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:01.554984 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dc0fa905-4f8a-4853-8260-41eb9fa854ed tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:01.555423 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dc0fa905-4f8a-4853-8260-41eb9fa854ed tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:01.585040 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-dc0fa905-4f8a-4853-8260-41eb9fa854ed tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044752 Jul 28 04:06:01.585600 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 338/736] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Jul 28 04:06:01 2022] GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:01.738384 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-632f6a2d-9293-424b-b51c-97592afde22d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:01.739129 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-632f6a2d-9293-424b-b51c-97592afde22d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:01.745871 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-632f6a2d-9293-424b-b51c-97592afde22d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:01.746326 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-632f6a2d-9293-424b-b51c-97592afde22d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:01.747123 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-632f6a2d-9293-424b-b51c-97592afde22d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:01.747569 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-632f6a2d-9293-424b-b51c-97592afde22d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:01.775994 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-632f6a2d-9293-424b-b51c-97592afde22d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53/os-volume_attachments/7cf91b2c-2690-4e7c-8c38-653864e620cb" status: 200 len: 194 microversion: 2.1 time: 0.042034 Jul 28 04:06:01.776566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 399/737] 10.222.0.46 () {58 vars in 1413 bytes} [Thu Jul 28 04:06:01 2022] GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53/os-volume_attachments/7cf91b2c-2690-4e7c-8c38-653864e620cb => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:01.787603 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a8c1030a-c54e-4a48-ba59-876eb71dee36 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:01.788106 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-a8c1030a-c54e-4a48-ba59-876eb71dee36 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:01.794068 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a8c1030a-c54e-4a48-ba59-876eb71dee36 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:01.794521 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a8c1030a-c54e-4a48-ba59-876eb71dee36 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:01.795323 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a8c1030a-c54e-4a48-ba59-876eb71dee36 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:01.795766 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a8c1030a-c54e-4a48-ba59-876eb71dee36 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:01.798380 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:01.877157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.objects.instance [None req-a8c1030a-c54e-4a48-ba59-876eb71dee36 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lazy-loading 'services' on Instance uuid 5ba939cf-1f23-4c51-9726-de6bc52c5a53 {{(pid=118186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:06:01.947524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-a8c1030a-c54e-4a48-ba59-876eb71dee36 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53/os-volume_attachments/7cf91b2c-2690-4e7c-8c38-653864e620cb" status: 202 len: 0 microversion: 2.1 time: 0.163905 Jul 28 04:06:01.948111 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 339/738] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Jul 28 04:06:01 2022] DELETE /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53/os-volume_attachments/7cf91b2c-2690-4e7c-8c38-653864e620cb => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:06:03.070236 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f77fefcd-e8f0-48cb-9ed2-322799622178 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:03.070856 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f77fefcd-e8f0-48cb-9ed2-322799622178 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:03.077190 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f77fefcd-e8f0-48cb-9ed2-322799622178 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:03.077645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f77fefcd-e8f0-48cb-9ed2-322799622178 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:03.079102 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f77fefcd-e8f0-48cb-9ed2-322799622178 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:03.079565 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f77fefcd-e8f0-48cb-9ed2-322799622178 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:03.108527 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f77fefcd-e8f0-48cb-9ed2-322799622178 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53/os-volume_attachments/4334cbf7-278c-42c2-84fa-d5f109ffd951" status: 200 len: 194 microversion: 2.1 time: 0.042353 Jul 28 04:06:03.109115 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 400/739] 10.222.0.46 () {58 vars in 1413 bytes} [Thu Jul 28 04:06:03 2022] GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53/os-volume_attachments/4334cbf7-278c-42c2-84fa-d5f109ffd951 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:06:03.120671 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-45d3a8bb-6443-4d1b-a076-13f58aef2bc1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:03.121289 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-45d3a8bb-6443-4d1b-a076-13f58aef2bc1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:03.127816 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-45d3a8bb-6443-4d1b-a076-13f58aef2bc1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:03.128273 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-45d3a8bb-6443-4d1b-a076-13f58aef2bc1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:03.129036 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-45d3a8bb-6443-4d1b-a076-13f58aef2bc1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:03.129476 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-45d3a8bb-6443-4d1b-a076-13f58aef2bc1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:03.210819 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.objects.instance [None req-45d3a8bb-6443-4d1b-a076-13f58aef2bc1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lazy-loading 'services' on Instance uuid 5ba939cf-1f23-4c51-9726-de6bc52c5a53 {{(pid=118186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:06:03.281539 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-45d3a8bb-6443-4d1b-a076-13f58aef2bc1 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53/os-volume_attachments/4334cbf7-278c-42c2-84fa-d5f109ffd951" status: 202 len: 0 microversion: 2.1 time: 0.165555 Jul 28 04:06:03.282147 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 340/740] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Jul 28 04:06:03 2022] DELETE /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53/os-volume_attachments/4334cbf7-278c-42c2-84fa-d5f109ffd951 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:06:04.454644 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9a46c255-2fb5-405e-ade8-5709a26b6098 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:04.457257 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9a46c255-2fb5-405e-ade8-5709a26b6098 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:04.464190 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9a46c255-2fb5-405e-ade8-5709a26b6098 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:04.464641 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9a46c255-2fb5-405e-ade8-5709a26b6098 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:04.465403 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9a46c255-2fb5-405e-ade8-5709a26b6098 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:04.465856 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9a46c255-2fb5-405e-ade8-5709a26b6098 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:04.495218 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9a46c255-2fb5-405e-ade8-5709a26b6098 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045026 Jul 28 04:06:04.495768 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 401/741] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Jul 28 04:06:04 2022] GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:06:04.608646 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-1d83069b-7136-41b4-b62b-13b8d57cf95b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:04.611319 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-1d83069b-7136-41b4-b62b-13b8d57cf95b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:04.617554 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1d83069b-7136-41b4-b62b-13b8d57cf95b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:04.618003 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1d83069b-7136-41b4-b62b-13b8d57cf95b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:04.618771 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1d83069b-7136-41b4-b62b-13b8d57cf95b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:04.619229 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1d83069b-7136-41b4-b62b-13b8d57cf95b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:04.647634 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-1d83069b-7136-41b4-b62b-13b8d57cf95b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043915 Jul 28 04:06:04.648188 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 341/742] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Jul 28 04:06:04 2022] GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:06:04.708896 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5deead30-3e67-48bc-9657-c01d165e2f3d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:04.709392 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5deead30-3e67-48bc-9657-c01d165e2f3d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:04.715588 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5deead30-3e67-48bc-9657-c01d165e2f3d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:04.716035 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5deead30-3e67-48bc-9657-c01d165e2f3d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:04.716785 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5deead30-3e67-48bc-9657-c01d165e2f3d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:04.717216 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5deead30-3e67-48bc-9657-c01d165e2f3d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:04.743304 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5deead30-3e67-48bc-9657-c01d165e2f3d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Going to try to terminate instance {{(pid=118187) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:06:04.818035 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5deead30-3e67-48bc-9657-c01d165e2f3d tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53" status: 204 len: 0 microversion: 2.1 time: 0.113400 Jul 28 04:06:04.818612 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 402/743] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:06:04 2022] DELETE /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:06:04.827171 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-797e177b-725d-4cf0-97fd-d0eca5796c6f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:04.827869 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-797e177b-725d-4cf0-97fd-d0eca5796c6f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:04.834832 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-797e177b-725d-4cf0-97fd-d0eca5796c6f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:04.835288 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-797e177b-725d-4cf0-97fd-d0eca5796c6f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:04.836055 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-797e177b-725d-4cf0-97fd-d0eca5796c6f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:04.836492 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-797e177b-725d-4cf0-97fd-d0eca5796c6f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:04.966738 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-797e177b-725d-4cf0-97fd-d0eca5796c6f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:04.975622 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-797e177b-725d-4cf0-97fd-d0eca5796c6f tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53" status: 200 len: 1673 microversion: 2.1 time: 0.152448 Jul 28 04:06:04.976194 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 342/744] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:04 2022] GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:06:04.986907 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8a473c85-d97f-4072-8fa4-2be722843fcc tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:04.986907 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8a473c85-d97f-4072-8fa4-2be722843fcc tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:04.986907 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8a473c85-d97f-4072-8fa4-2be722843fcc tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:04.986907 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8a473c85-d97f-4072-8fa4-2be722843fcc tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:04.987293 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8a473c85-d97f-4072-8fa4-2be722843fcc tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:04.987293 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8a473c85-d97f-4072-8fa4-2be722843fcc tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:05.011985 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8a473c85-d97f-4072-8fa4-2be722843fcc tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Going to try to terminate instance {{(pid=118187) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:06:05.085346 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8a473c85-d97f-4072-8fa4-2be722843fcc tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 204 len: 0 microversion: 2.1 time: 0.111727 Jul 28 04:06:05.086000 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 403/745] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:06:04 2022] DELETE /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:06:05.094094 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-f9bda741-6cea-4694-bdf7-c10f16760e5d tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:05.095342 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-f9bda741-6cea-4694-bdf7-c10f16760e5d tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:05.101313 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f9bda741-6cea-4694-bdf7-c10f16760e5d tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:05.101762 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f9bda741-6cea-4694-bdf7-c10f16760e5d tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:05.102527 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f9bda741-6cea-4694-bdf7-c10f16760e5d tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:05.102992 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f9bda741-6cea-4694-bdf7-c10f16760e5d tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:05.236205 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-f9bda741-6cea-4694-bdf7-c10f16760e5d tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:05.243757 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-f9bda741-6cea-4694-bdf7-c10f16760e5d tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 200 len: 1575 microversion: 2.1 time: 0.153472 Jul 28 04:06:05.244351 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 343/746] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:05 2022] GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:05.998610 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9a0d7672-bf9e-4e73-8c66-0a0221780300 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:06.000419 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9a0d7672-bf9e-4e73-8c66-0a0221780300 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:06.006188 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9a0d7672-bf9e-4e73-8c66-0a0221780300 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:06.006635 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9a0d7672-bf9e-4e73-8c66-0a0221780300 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:06.007425 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9a0d7672-bf9e-4e73-8c66-0a0221780300 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:06.007861 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9a0d7672-bf9e-4e73-8c66-0a0221780300 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:06.138502 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9a0d7672-bf9e-4e73-8c66-0a0221780300 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:06.146947 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9a0d7672-bf9e-4e73-8c66-0a0221780300 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53" status: 200 len: 1673 microversion: 2.1 time: 0.152497 Jul 28 04:06:06.147507 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 404/747] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:05 2022] GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53 => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:06.265091 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-8100f95d-1c59-422f-b292-2389cf9e2486 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:06.265617 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-8100f95d-1c59-422f-b292-2389cf9e2486 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:06.273019 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8100f95d-1c59-422f-b292-2389cf9e2486 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:06.273465 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8100f95d-1c59-422f-b292-2389cf9e2486 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:06.274218 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8100f95d-1c59-422f-b292-2389cf9e2486 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:06.274649 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8100f95d-1c59-422f-b292-2389cf9e2486 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:06.407821 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-8100f95d-1c59-422f-b292-2389cf9e2486 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:06.415621 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-8100f95d-1c59-422f-b292-2389cf9e2486 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 200 len: 1575 microversion: 2.1 time: 0.154419 Jul 28 04:06:06.416191 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 344/748] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:06 2022] GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:07.169326 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a589f7bd-8abe-4871-902c-c9e91ff45005 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:07.169939 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a589f7bd-8abe-4871-902c-c9e91ff45005 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:07.177110 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a589f7bd-8abe-4871-902c-c9e91ff45005 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:07.177558 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a589f7bd-8abe-4871-902c-c9e91ff45005 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:07.178318 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a589f7bd-8abe-4871-902c-c9e91ff45005 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:07.178829 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a589f7bd-8abe-4871-902c-c9e91ff45005 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:07.306382 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a589f7bd-8abe-4871-902c-c9e91ff45005 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:07.314284 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a589f7bd-8abe-4871-902c-c9e91ff45005 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53" status: 200 len: 1673 microversion: 2.1 time: 0.148850 Jul 28 04:06:07.314863 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 405/749] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:07 2022] GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53 => generated 1673 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:07.437059 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-ed785e98-a403-41ca-ac65-1a3b6ca0f081 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:07.437611 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-ed785e98-a403-41ca-ac65-1a3b6ca0f081 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:07.444871 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ed785e98-a403-41ca-ac65-1a3b6ca0f081 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:07.445326 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ed785e98-a403-41ca-ac65-1a3b6ca0f081 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:07.446126 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ed785e98-a403-41ca-ac65-1a3b6ca0f081 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:07.446568 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ed785e98-a403-41ca-ac65-1a3b6ca0f081 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:07.580799 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-ed785e98-a403-41ca-ac65-1a3b6ca0f081 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:07.588227 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-ed785e98-a403-41ca-ac65-1a3b6ca0f081 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 200 len: 1575 microversion: 2.1 time: 0.155160 Jul 28 04:06:07.588791 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 345/750] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:07 2022] GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:08.335969 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ebfbcc26-11ff-4602-b722-922cd89b0119 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:08.336648 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ebfbcc26-11ff-4602-b722-922cd89b0119 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:08.343259 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ebfbcc26-11ff-4602-b722-922cd89b0119 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:08.343711 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ebfbcc26-11ff-4602-b722-922cd89b0119 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:08.344489 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ebfbcc26-11ff-4602-b722-922cd89b0119 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:08.345174 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ebfbcc26-11ff-4602-b722-922cd89b0119 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:08.486096 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ebfbcc26-11ff-4602-b722-922cd89b0119 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:08.493882 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ebfbcc26-11ff-4602-b722-922cd89b0119 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53" status: 200 len: 1673 microversion: 2.1 time: 0.161925 Jul 28 04:06:08.494469 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 406/751] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:08 2022] GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53 => generated 1673 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:08.609091 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-b6c242ba-95e3-4876-92a3-608e514f109a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:08.609712 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-b6c242ba-95e3-4876-92a3-608e514f109a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:08.617332 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b6c242ba-95e3-4876-92a3-608e514f109a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:08.617784 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b6c242ba-95e3-4876-92a3-608e514f109a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:08.618553 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b6c242ba-95e3-4876-92a3-608e514f109a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:08.619016 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b6c242ba-95e3-4876-92a3-608e514f109a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:08.932744 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-b6c242ba-95e3-4876-92a3-608e514f109a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:08.940564 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-b6c242ba-95e3-4876-92a3-608e514f109a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 200 len: 1575 microversion: 2.1 time: 0.335304 Jul 28 04:06:08.941150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 346/752] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:08 2022] GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 1575 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:09.514896 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-376ecfd7-3304-441d-92b8-3598b347c374 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:09.515443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-376ecfd7-3304-441d-92b8-3598b347c374 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:09.522062 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-376ecfd7-3304-441d-92b8-3598b347c374 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:09.522504 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-376ecfd7-3304-441d-92b8-3598b347c374 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:09.524102 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-376ecfd7-3304-441d-92b8-3598b347c374 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:09.525181 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-376ecfd7-3304-441d-92b8-3598b347c374 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:09.597331 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-376ecfd7-3304-441d-92b8-3598b347c374 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7112379fb6794027a7c1519b2f77a5d4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5db0f08a14ac472fb3edf2107c9ccfc5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:09.607185 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-376ecfd7-3304-441d-92b8-3598b347c374 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53" status: 200 len: 1606 microversion: 2.1 time: 0.096089 Jul 28 04:06:09.617846 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 407/753] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:09 2022] GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53 => generated 1606 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:09.705921 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-bb053be4-a6c0-4811-8696-225d34591d68 req-9863fb3a-4b71-4d3e-8039-f905c2ac180c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba939cf-1f23-4c51-9726-de6bc52c5a53", "name": "network-vif-deleted", "tag": "971f1529-be5d-4544-a99f-c6a4b11153dd"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:09.720149 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-bb053be4-a6c0-4811-8696-225d34591d68 req-9863fb3a-4b71-4d3e-8039-f905c2ac180c service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:09.725259 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-bb053be4-a6c0-4811-8696-225d34591d68 req-9863fb3a-4b71-4d3e-8039-f905c2ac180c service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:09.745170 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-bb053be4-a6c0-4811-8696-225d34591d68 req-9863fb3a-4b71-4d3e-8039-f905c2ac180c service nova] Creating event network-vif-deleted:971f1529-be5d-4544-a99f-c6a4b11153dd for instance 5ba939cf-1f23-4c51-9726-de6bc52c5a53 on hv-cinder-79987 Jul 28 04:06:09.752139 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-bb053be4-a6c0-4811-8696-225d34591d68 req-9863fb3a-4b71-4d3e-8039-f905c2ac180c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050050 Jul 28 04:06:09.753582 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 347/754] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:09.961611 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a0220dcd-ffe1-4f4e-b59e-1bddbdcdf98b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:09.962316 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a0220dcd-ffe1-4f4e-b59e-1bddbdcdf98b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:09.968724 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a0220dcd-ffe1-4f4e-b59e-1bddbdcdf98b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:09.970107 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a0220dcd-ffe1-4f4e-b59e-1bddbdcdf98b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:09.971607 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a0220dcd-ffe1-4f4e-b59e-1bddbdcdf98b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:09.973024 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a0220dcd-ffe1-4f4e-b59e-1bddbdcdf98b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:10.047834 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a0220dcd-ffe1-4f4e-b59e-1bddbdcdf98b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:10.056824 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a0220dcd-ffe1-4f4e-b59e-1bddbdcdf98b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 200 len: 1225 microversion: 2.1 time: 0.099078 Jul 28 04:06:10.067785 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 408/755] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:09 2022] GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:10.636994 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-ec2d7a74-4ff2-4738-b6a7-fa0026a1bf9b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:10.637614 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-ec2d7a74-4ff2-4738-b6a7-fa0026a1bf9b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:10.648996 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ec2d7a74-4ff2-4738-b6a7-fa0026a1bf9b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:10.653199 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ec2d7a74-4ff2-4738-b6a7-fa0026a1bf9b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:10.654181 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ec2d7a74-4ff2-4738-b6a7-fa0026a1bf9b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:10.654759 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ec2d7a74-4ff2-4738-b6a7-fa0026a1bf9b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:10.680493 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.wsgi [None req-ec2d7a74-4ff2-4738-b6a7-fa0026a1bf9b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] HTTP exception thrown: Instance 5ba939cf-1f23-4c51-9726-de6bc52c5a53 could not be found. Jul 28 04:06:10.682157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-ec2d7a74-4ff2-4738-b6a7-fa0026a1bf9b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Request method failure captured: Jul 28 04:06:10.682157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: request: GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53 HTTP/1.1 Jul 28 04:06:10.682157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept: application/json Jul 28 04:06:10.682157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept-Encoding: identity Jul 28 04:06:10.682157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Connection: close Jul 28 04:06:10.682157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Length: 0 Jul 28 04:06:10.682157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Type: application/json Jul 28 04:06:10.682157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Host: 10.222.0.46 Jul 28 04:06:10.682157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Openstack-System-Scope: None Jul 28 04:06:10.682157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:10.682157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Auth-Token: gAAAAABi4gmvBMnfb8DTsIkgUa4MflJw_khZbOOklb3o8cTO1OBAYvtXeo1m8PBQrIox6r8bSG9QniIJnr_VCAM_w9OH-_z8cUBrcSv_yuSahr6_6JdG10-UT9QXWIA4LQaualsr4hMi4wp8NV2iLgQWCinAWb8VHl11UjNolYlN6vUa5fspesg Jul 28 04:06:10.682157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Id: None Jul 28 04:06:10.682157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Name: None Jul 28 04:06:10.682157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Identity-Status: Confirmed Jul 28 04:06:10.682157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Is-Admin-Project: True Jul 28 04:06:10.682157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Id: default Jul 28 04:06:10.682157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Name: Default Jul 28 04:06:10.682157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Id: 5db0f08a14ac472fb3edf2107c9ccfc5 Jul 28 04:06:10.682157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Name: tempest-AttachVolumeTestJSON-403862681 Jul 28 04:06:10.682157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Role: reader,member Jul 28 04:06:10.682157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Roles: reader,member Jul 28 04:06:10.683907 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5db0f08a14ac472fb3edf2107c9ccfc5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5db0f08a14ac472fb3edf2107c9ccfc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5db0f08a14ac472fb3edf2107c9ccfc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5db0f08a14ac472fb3edf2107c9ccfc5"}]}] Jul 28 04:06:10.683907 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant: tempest-AttachVolumeTestJSON-403862681 Jul 28 04:06:10.683907 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Id: 5db0f08a14ac472fb3edf2107c9ccfc5 Jul 28 04:06:10.683907 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Name: tempest-AttachVolumeTestJSON-403862681 Jul 28 04:06:10.683907 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User: tempest-AttachVolumeTestJSON-403862681-project Jul 28 04:06:10.683907 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Id: default Jul 28 04:06:10.683907 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Name: Default Jul 28 04:06:10.683907 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Id: 7112379fb6794027a7c1519b2f77a5d4 Jul 28 04:06:10.683907 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Name: tempest-AttachVolumeTestJSON-403862681-project Jul 28 04:06:10.683907 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: method: > Jul 28 04:06:10.683907 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: exception: Instance 5ba939cf-1f23-4c51-9726-de6bc52c5a53 could not be found. Jul 28 04:06:10.683907 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: action_args: {'id': '5ba939cf-1f23-4c51-9726-de6bc52c5a53'} Jul 28 04:06:10.684863 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:10.684863 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:10.684863 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:06:10.684863 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:06:10.684863 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:06:10.684863 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:06:10.684863 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:06:10.684863 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:06:10.684863 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:06:10.684863 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:06:10.684863 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ba939cf-1f23-4c51-9726-de6bc52c5a53 could not be found. Jul 28 04:06:10.684863 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:10.684863 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:10.684863 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:10.684863 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:10.684863 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:10.684863 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:10.684863 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:10.684863 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:10.684863 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:10.686411 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:10.686411 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:06:10.686411 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:06:10.686411 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:06:10.686411 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:06:10.686411 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:06:10.686411 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:06:10.686411 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ba939cf-1f23-4c51-9726-de6bc52c5a53 could not be found. Jul 28 04:06:10.686411 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:10.686411 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:10.686411 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:10.686411 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:10.686411 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:10.686411 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:10.686411 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:10.686411 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:10.686411 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ba939cf-1f23-4c51-9726-de6bc52c5a53 could not be found. Jul 28 04:06:10.686411 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:10.687931 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-ec2d7a74-4ff2-4738-b6a7-fa0026a1bf9b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Returning 404 to user: Instance 5ba939cf-1f23-4c51-9726-de6bc52c5a53 could not be found. {{(pid=118186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:10.687931 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-ec2d7a74-4ff2-4738-b6a7-fa0026a1bf9b tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53" status: 404 len: 111 microversion: 2.1 time: 0.057778 Jul 28 04:06:10.693954 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fd3a5806-bb2e-4516-8a38-51ae0fb8d231 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '.version_select at 0x7fa6ee010040>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:10.699521 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 348/756] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:10 2022] GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:06:10.717294 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-fd3a5806-bb2e-4516-8a38-51ae0fb8d231 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843428183" status: 202 len: 0 microversion: 2.1 time: 0.027570 Jul 28 04:06:10.717879 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 409/757] 10.222.0.46 () {58 vars in 1221 bytes} [Thu Jul 28 04:06:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1843428183 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:06:11.078992 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-fd657295-f246-45fe-ac1f-c6dae3cbbeb6 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:11.079768 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-fd657295-f246-45fe-ac1f-c6dae3cbbeb6 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:11.088625 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fd657295-f246-45fe-ac1f-c6dae3cbbeb6 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:11.089176 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fd657295-f246-45fe-ac1f-c6dae3cbbeb6 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:11.090806 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fd657295-f246-45fe-ac1f-c6dae3cbbeb6 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:11.091459 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fd657295-f246-45fe-ac1f-c6dae3cbbeb6 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:11.106227 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.wsgi [None req-fd657295-f246-45fe-ac1f-c6dae3cbbeb6 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] HTTP exception thrown: Instance 5b73f1a1-e07f-4ebe-af69-e188924a9073 could not be found. Jul 28 04:06:11.107853 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-fd657295-f246-45fe-ac1f-c6dae3cbbeb6 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Request method failure captured: Jul 28 04:06:11.107853 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: request: GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 HTTP/1.1 Jul 28 04:06:11.107853 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept: application/json Jul 28 04:06:11.107853 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept-Encoding: identity Jul 28 04:06:11.107853 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Connection: close Jul 28 04:06:11.107853 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Length: 0 Jul 28 04:06:11.107853 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Type: application/json Jul 28 04:06:11.107853 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Host: 10.222.0.46 Jul 28 04:06:11.107853 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Openstack-System-Scope: None Jul 28 04:06:11.107853 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:11.107853 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Auth-Token: gAAAAABi4gpzwOklwNPcAxBHZOI1ssvbTDgevywfPDg1yEt0tUb4vs9CGIW1HscS9ZkGWtQaBkjtwjYHRZPMEfCBroYl-luuwuhVsCRgo82EETIhmv-q8utzHf0HSy0tMariOS19fBjcoglWOQOMyj-zi_XUYhE5beKJEpg4A_NllVniOatsHmc Jul 28 04:06:11.107853 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Id: None Jul 28 04:06:11.107853 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Name: None Jul 28 04:06:11.107853 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Identity-Status: Confirmed Jul 28 04:06:11.107853 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Is-Admin-Project: True Jul 28 04:06:11.107853 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Id: default Jul 28 04:06:11.107853 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Name: Default Jul 28 04:06:11.107853 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Id: 338679f381ed4e9e898a59289b0f8178 Jul 28 04:06:11.107853 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Name: tempest-TestVolumeBootPattern-143181242 Jul 28 04:06:11.107853 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Role: reader,member Jul 28 04:06:11.107853 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Roles: reader,member Jul 28 04:06:11.109343 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_338679f381ed4e9e898a59289b0f8178", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/338679f381ed4e9e898a59289b0f8178"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/338679f381ed4e9e898a59289b0f8178"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/338679f381ed4e9e898a59289b0f8178"}]}] Jul 28 04:06:11.109343 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant: tempest-TestVolumeBootPattern-143181242 Jul 28 04:06:11.109343 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Id: 338679f381ed4e9e898a59289b0f8178 Jul 28 04:06:11.109343 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Name: tempest-TestVolumeBootPattern-143181242 Jul 28 04:06:11.109343 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User: tempest-TestVolumeBootPattern-143181242-project Jul 28 04:06:11.109343 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Id: default Jul 28 04:06:11.109343 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Name: Default Jul 28 04:06:11.109343 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Id: 352d60372ba249e38ea4aa2d62723f19 Jul 28 04:06:11.109343 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Name: tempest-TestVolumeBootPattern-143181242-project Jul 28 04:06:11.109343 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: method: > Jul 28 04:06:11.109343 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: exception: Instance 5b73f1a1-e07f-4ebe-af69-e188924a9073 could not be found. Jul 28 04:06:11.109343 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: action_args: {'id': '5b73f1a1-e07f-4ebe-af69-e188924a9073'} Jul 28 04:06:11.110988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:11.110988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:11.110988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:06:11.110988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:06:11.110988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:06:11.110988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:06:11.110988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:06:11.110988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:06:11.110988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:06:11.110988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:06:11.110988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b73f1a1-e07f-4ebe-af69-e188924a9073 could not be found. Jul 28 04:06:11.110988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:11.110988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:11.110988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:11.110988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:11.110988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:11.110988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:11.110988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:11.110988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:11.110988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:11.112686 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:11.112686 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:06:11.112686 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:06:11.112686 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:06:11.112686 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:06:11.112686 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:06:11.112686 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:06:11.112686 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b73f1a1-e07f-4ebe-af69-e188924a9073 could not be found. Jul 28 04:06:11.112686 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:11.112686 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:11.112686 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:11.112686 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:11.112686 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:11.112686 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:11.112686 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:11.112686 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:11.112686 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b73f1a1-e07f-4ebe-af69-e188924a9073 could not be found. Jul 28 04:06:11.112686 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:11.113973 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-fd657295-f246-45fe-ac1f-c6dae3cbbeb6 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Returning 404 to user: Instance 5b73f1a1-e07f-4ebe-af69-e188924a9073 could not be found. {{(pid=118186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:11.113973 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-fd657295-f246-45fe-ac1f-c6dae3cbbeb6 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 404 len: 111 microversion: 2.1 time: 0.034958 Jul 28 04:06:11.113973 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 349/758] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:11 2022] GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:06:11.268578 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-72e71303-9c10-4bdf-bc11-a82358f563a4 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1656727473", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1551827242", "security_groups": [{"name": "tempest-secgroup-smoke-15930751"}], "block_device_mapping_v2": [{"uuid": "3aa14d38-16eb-4031-a2b9-ddbaf41ee57b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1c80a3f8-351e-4afc-86dc-eff91807353a"}]}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:11.389626 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.network.neutron [None req-72e71303-9c10-4bdf-bc11-a82358f563a4 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] validate_networks() for [('1c80a3f8-351e-4afc-86dc-eff91807353a', None, None, None, None, None)] {{(pid=118187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:06:11.767991 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-72e71303-9c10-4bdf-bc11-a82358f563a4 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Flavor limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:06:11.768594 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-72e71303-9c10-4bdf-bc11-a82358f563a4 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Image limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:06:11.768866 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-72e71303-9c10-4bdf-bc11-a82358f563a4 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Flavor pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:06:11.769270 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-72e71303-9c10-4bdf-bc11-a82358f563a4 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Image pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:06:11.769673 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-72e71303-9c10-4bdf-bc11-a82358f563a4 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:06:11.770472 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-df86d7aa-4f36-4b26-a6c6-f87474938727 req-cd92de07-2e56-421e-8f7b-60fe17bab785 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b73f1a1-e07f-4ebe-af69-e188924a9073", "name": "network-vif-deleted", "tag": "8f78dd8c-353e-4f87-bef6-e8bc130d65a0"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:11.778909 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-72e71303-9c10-4bdf-bc11-a82358f563a4 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:11.779343 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-72e71303-9c10-4bdf-bc11-a82358f563a4 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:11.780456 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-df86d7aa-4f36-4b26-a6c6-f87474938727 req-cd92de07-2e56-421e-8f7b-60fe17bab785 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:11.780789 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-72e71303-9c10-4bdf-bc11-a82358f563a4 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:11.781121 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-df86d7aa-4f36-4b26-a6c6-f87474938727 req-cd92de07-2e56-421e-8f7b-60fe17bab785 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:11.781334 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-72e71303-9c10-4bdf-bc11-a82358f563a4 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:11.792912 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-df86d7aa-4f36-4b26-a6c6-f87474938727 req-cd92de07-2e56-421e-8f7b-60fe17bab785 service nova] Creating event network-vif-deleted:8f78dd8c-353e-4f87-bef6-e8bc130d65a0 for instance 5b73f1a1-e07f-4ebe-af69-e188924a9073 on hv-cinder-79987 Jul 28 04:06:11.797745 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-df86d7aa-4f36-4b26-a6c6-f87474938727 req-cd92de07-2e56-421e-8f7b-60fe17bab785 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031807 Jul 28 04:06:11.798464 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 350/759] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:06:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:06:11.800910 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-72e71303-9c10-4bdf-bc11-a82358f563a4 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Getting quotas for project 338679f381ed4e9e898a59289b0f8178. Resources: {'instances', 'cores', 'ram'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:06:11.804887 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-72e71303-9c10-4bdf-bc11-a82358f563a4 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Getting quotas for user 352d60372ba249e38ea4aa2d62723f19 and project 338679f381ed4e9e898a59289b0f8178. Resources: {'instances', 'cores', 'ram'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:06:11.862731 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-72e71303-9c10-4bdf-bc11-a82358f563a4 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Going to run 1 instances... {{(pid=118187) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:06:11.864808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-72e71303-9c10-4bdf-bc11-a82358f563a4 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 042cba62-5323-4dd0-9ad7-92ec0f0746c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='3aa14d38-16eb-4031-a2b9-ddbaf41ee57b',volume_size=None,volume_type=None)] {{(pid=118187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:06:11.912156 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-5e27c3e3-e305-4601-9044-5ff6a5906e83 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:11.912771 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-5e27c3e3-e305-4601-9044-5ff6a5906e83 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:11.919319 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5e27c3e3-e305-4601-9044-5ff6a5906e83 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:11.919763 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5e27c3e3-e305-4601-9044-5ff6a5906e83 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:11.920534 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5e27c3e3-e305-4601-9044-5ff6a5906e83 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:11.921011 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5e27c3e3-e305-4601-9044-5ff6a5906e83 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:11.947388 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-5e27c3e3-e305-4601-9044-5ff6a5906e83 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150/ips" status: 200 len: 149 microversion: 2.1 time: 0.039598 Jul 28 04:06:11.947953 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 351/760] 10.222.0.46 () {58 vars in 1248 bytes} [Thu Jul 28 04:06:11 2022] GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:06:11.995435 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-72e71303-9c10-4bdf-bc11-a82358f563a4 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.731331 Jul 28 04:06:11.996089 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 410/761] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 04:06:11 2022] POST /compute/v2.1/servers => generated 404 bytes in 733 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:06:12.008501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-fecba90a-e290-4988-8673-b8c18a5f2199 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:12.009399 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-fecba90a-e290-4988-8673-b8c18a5f2199 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 042cba62-5323-4dd0-9ad7-92ec0f0746c5] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:12.080766 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-fecba90a-e290-4988-8673-b8c18a5f2199 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:12.088818 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-fecba90a-e290-4988-8673-b8c18a5f2199 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5" status: 200 len: 1095 microversion: 2.1 time: 0.085262 Jul 28 04:06:12.090012 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 352/762] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:12 2022] GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5 => generated 1095 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:13.110204 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-73a2b67f-0b36-4a67-884c-568621e8c3eb tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:13.112481 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-73a2b67f-0b36-4a67-884c-568621e8c3eb tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 042cba62-5323-4dd0-9ad7-92ec0f0746c5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:13.121121 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-73a2b67f-0b36-4a67-884c-568621e8c3eb tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:13.121679 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-73a2b67f-0b36-4a67-884c-568621e8c3eb tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:13.122523 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-73a2b67f-0b36-4a67-884c-568621e8c3eb tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:13.123162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-73a2b67f-0b36-4a67-884c-568621e8c3eb tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:13.189311 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-73a2b67f-0b36-4a67-884c-568621e8c3eb tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:13.197176 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-73a2b67f-0b36-4a67-884c-568621e8c3eb tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5" status: 200 len: 1211 microversion: 2.1 time: 0.091219 Jul 28 04:06:13.198034 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 411/763] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:13 2022] GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5 => generated 1211 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:06:13.317218 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-2561d57b-9284-4161-a0f7-153bd8e73f2e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "667838c2-c8cd-46fb-8a7d-538d76f7b91a"}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:13.320436 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-2561d57b-9284-4161-a0f7-153bd8e73f2e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:13.329292 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2561d57b-9284-4161-a0f7-153bd8e73f2e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:13.329663 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2561d57b-9284-4161-a0f7-153bd8e73f2e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:13.330432 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2561d57b-9284-4161-a0f7-153bd8e73f2e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:13.330898 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2561d57b-9284-4161-a0f7-153bd8e73f2e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:13.597852 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-2561d57b-9284-4161-a0f7-153bd8e73f2e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "POST /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284574 Jul 28 04:06:13.604066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 353/764] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Jul 28 04:06:13 2022] POST /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:13.704655 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2d3bc9a4-7ee3-412d-8a73-9c8b9f6c35e5 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:13.705437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-2d3bc9a4-7ee3-412d-8a73-9c8b9f6c35e5 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:13.712908 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2d3bc9a4-7ee3-412d-8a73-9c8b9f6c35e5 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:13.713365 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2d3bc9a4-7ee3-412d-8a73-9c8b9f6c35e5 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:13.714460 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2d3bc9a4-7ee3-412d-8a73-9c8b9f6c35e5 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:13.714928 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2d3bc9a4-7ee3-412d-8a73-9c8b9f6c35e5 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:13.731263 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-2d3bc9a4-7ee3-412d-8a73-9c8b9f6c35e5 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] HTTP exception thrown: Instance 5ba939cf-1f23-4c51-9726-de6bc52c5a53 could not be found. Jul 28 04:06:13.732873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2d3bc9a4-7ee3-412d-8a73-9c8b9f6c35e5 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Request method failure captured: Jul 28 04:06:13.732873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: DELETE /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53 HTTP/1.1 Jul 28 04:06:13.732873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:06:13.732873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:06:13.732873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:06:13.732873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:06:13.732873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:06:13.732873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:06:13.732873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:06:13.732873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:13.732873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gmvBMnfb8DTsIkgUa4MflJw_khZbOOklb3o8cTO1OBAYvtXeo1m8PBQrIox6r8bSG9QniIJnr_VCAM_w9OH-_z8cUBrcSv_yuSahr6_6JdG10-UT9QXWIA4LQaualsr4hMi4wp8NV2iLgQWCinAWb8VHl11UjNolYlN6vUa5fspesg Jul 28 04:06:13.732873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:06:13.732873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:06:13.732873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:06:13.732873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:06:13.732873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:06:13.732873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:06:13.732873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 5db0f08a14ac472fb3edf2107c9ccfc5 Jul 28 04:06:13.732873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeTestJSON-403862681 Jul 28 04:06:13.732873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:06:13.732873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:06:13.735596 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5db0f08a14ac472fb3edf2107c9ccfc5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5db0f08a14ac472fb3edf2107c9ccfc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5db0f08a14ac472fb3edf2107c9ccfc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5db0f08a14ac472fb3edf2107c9ccfc5"}]}] Jul 28 04:06:13.735596 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeTestJSON-403862681 Jul 28 04:06:13.735596 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 5db0f08a14ac472fb3edf2107c9ccfc5 Jul 28 04:06:13.735596 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeTestJSON-403862681 Jul 28 04:06:13.735596 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeTestJSON-403862681-project Jul 28 04:06:13.735596 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:06:13.735596 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:06:13.735596 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: 7112379fb6794027a7c1519b2f77a5d4 Jul 28 04:06:13.735596 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeTestJSON-403862681-project Jul 28 04:06:13.735596 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:06:13.735596 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Instance 5ba939cf-1f23-4c51-9726-de6bc52c5a53 could not be found. Jul 28 04:06:13.735596 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': '5ba939cf-1f23-4c51-9726-de6bc52c5a53'} Jul 28 04:06:13.736413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:13.736413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:13.736413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:06:13.736413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:06:13.736413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:06:13.736413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:06:13.736413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:06:13.736413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:06:13.736413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:06:13.736413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:06:13.736413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ba939cf-1f23-4c51-9726-de6bc52c5a53 could not be found. Jul 28 04:06:13.736413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:13.736413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:13.736413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:13.736413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:13.736413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:13.736413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:13.736413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:13.736413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:13.736413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:13.737614 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:13.737614 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:06:13.737614 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:06:13.737614 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:06:13.737614 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:06:13.737614 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:06:13.737614 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:06:13.737614 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:06:13.737614 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:06:13.737614 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ba939cf-1f23-4c51-9726-de6bc52c5a53 could not be found. Jul 28 04:06:13.737614 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:13.737614 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:13.737614 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:13.737614 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:13.737614 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:13.737614 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:13.737614 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:13.737614 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:13.737614 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ba939cf-1f23-4c51-9726-de6bc52c5a53 could not be found. Jul 28 04:06:13.737614 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:13.742096 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2d3bc9a4-7ee3-412d-8a73-9c8b9f6c35e5 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Returning 404 to user: Instance 5ba939cf-1f23-4c51-9726-de6bc52c5a53 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:13.742096 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-2d3bc9a4-7ee3-412d-8a73-9c8b9f6c35e5 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53" status: 404 len: 111 microversion: 2.1 time: 0.035458 Jul 28 04:06:13.748688 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 412/765] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:06:13 2022] DELETE /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:06:13.752761 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a9bd4c9a-1883-44ed-948b-cbb2bd0c1a84 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:13.753454 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-a9bd4c9a-1883-44ed-948b-cbb2bd0c1a84 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: 5ba939cf-1f23-4c51-9726-de6bc52c5a53] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:13.768038 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a9bd4c9a-1883-44ed-948b-cbb2bd0c1a84 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:13.768491 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a9bd4c9a-1883-44ed-948b-cbb2bd0c1a84 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:13.769272 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a9bd4c9a-1883-44ed-948b-cbb2bd0c1a84 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:13.769705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a9bd4c9a-1883-44ed-948b-cbb2bd0c1a84 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:13.784972 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.wsgi [None req-a9bd4c9a-1883-44ed-948b-cbb2bd0c1a84 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] HTTP exception thrown: Instance 5ba939cf-1f23-4c51-9726-de6bc52c5a53 could not be found. Jul 28 04:06:13.789609 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a9bd4c9a-1883-44ed-948b-cbb2bd0c1a84 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Request method failure captured: Jul 28 04:06:13.789609 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: request: GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53 HTTP/1.1 Jul 28 04:06:13.789609 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept: application/json Jul 28 04:06:13.789609 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept-Encoding: identity Jul 28 04:06:13.789609 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Connection: close Jul 28 04:06:13.789609 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Length: 0 Jul 28 04:06:13.789609 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Type: application/json Jul 28 04:06:13.789609 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Host: 10.222.0.46 Jul 28 04:06:13.789609 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Openstack-System-Scope: None Jul 28 04:06:13.789609 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:13.789609 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Auth-Token: gAAAAABi4gmvBMnfb8DTsIkgUa4MflJw_khZbOOklb3o8cTO1OBAYvtXeo1m8PBQrIox6r8bSG9QniIJnr_VCAM_w9OH-_z8cUBrcSv_yuSahr6_6JdG10-UT9QXWIA4LQaualsr4hMi4wp8NV2iLgQWCinAWb8VHl11UjNolYlN6vUa5fspesg Jul 28 04:06:13.789609 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Id: None Jul 28 04:06:13.789609 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Name: None Jul 28 04:06:13.789609 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Identity-Status: Confirmed Jul 28 04:06:13.789609 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Is-Admin-Project: True Jul 28 04:06:13.789609 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Id: default Jul 28 04:06:13.789609 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Name: Default Jul 28 04:06:13.789609 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Id: 5db0f08a14ac472fb3edf2107c9ccfc5 Jul 28 04:06:13.789609 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Name: tempest-AttachVolumeTestJSON-403862681 Jul 28 04:06:13.789609 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Role: reader,member Jul 28 04:06:13.789609 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Roles: reader,member Jul 28 04:06:13.790970 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5db0f08a14ac472fb3edf2107c9ccfc5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5db0f08a14ac472fb3edf2107c9ccfc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5db0f08a14ac472fb3edf2107c9ccfc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5db0f08a14ac472fb3edf2107c9ccfc5"}]}] Jul 28 04:06:13.790970 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant: tempest-AttachVolumeTestJSON-403862681 Jul 28 04:06:13.790970 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Id: 5db0f08a14ac472fb3edf2107c9ccfc5 Jul 28 04:06:13.790970 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Name: tempest-AttachVolumeTestJSON-403862681 Jul 28 04:06:13.790970 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User: tempest-AttachVolumeTestJSON-403862681-project Jul 28 04:06:13.790970 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Id: default Jul 28 04:06:13.790970 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Name: Default Jul 28 04:06:13.790970 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Id: 7112379fb6794027a7c1519b2f77a5d4 Jul 28 04:06:13.790970 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Name: tempest-AttachVolumeTestJSON-403862681-project Jul 28 04:06:13.790970 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: method: > Jul 28 04:06:13.790970 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: exception: Instance 5ba939cf-1f23-4c51-9726-de6bc52c5a53 could not be found. Jul 28 04:06:13.790970 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: action_args: {'id': '5ba939cf-1f23-4c51-9726-de6bc52c5a53'} Jul 28 04:06:13.791705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:13.791705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:13.791705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:06:13.791705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:06:13.791705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:06:13.791705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:06:13.791705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:06:13.791705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:06:13.791705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:06:13.791705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:06:13.791705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ba939cf-1f23-4c51-9726-de6bc52c5a53 could not be found. Jul 28 04:06:13.791705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:13.791705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:13.791705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:13.791705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:13.791705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:13.791705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:13.791705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:13.791705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:13.791705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:13.793097 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:13.793097 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:06:13.793097 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:06:13.793097 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:06:13.793097 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:06:13.793097 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:06:13.793097 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:06:13.793097 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ba939cf-1f23-4c51-9726-de6bc52c5a53 could not be found. Jul 28 04:06:13.793097 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:13.793097 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:13.793097 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:13.793097 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:13.793097 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:13.793097 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:13.793097 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:13.793097 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:13.793097 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ba939cf-1f23-4c51-9726-de6bc52c5a53 could not be found. Jul 28 04:06:13.793097 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:13.794207 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a9bd4c9a-1883-44ed-948b-cbb2bd0c1a84 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Returning 404 to user: Instance 5ba939cf-1f23-4c51-9726-de6bc52c5a53 could not be found. {{(pid=118186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:13.794207 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-a9bd4c9a-1883-44ed-948b-cbb2bd0c1a84 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53" status: 404 len: 111 microversion: 2.1 time: 0.042633 Jul 28 04:06:13.794207 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 354/766] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:13 2022] GET /compute/v2.1/servers/5ba939cf-1f23-4c51-9726-de6bc52c5a53 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:06:14.217384 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2686a44d-e86a-48e6-a7fc-eb468a10cac9 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:14.218092 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-2686a44d-e86a-48e6-a7fc-eb468a10cac9 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 042cba62-5323-4dd0-9ad7-92ec0f0746c5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:14.228798 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2686a44d-e86a-48e6-a7fc-eb468a10cac9 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:14.229249 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2686a44d-e86a-48e6-a7fc-eb468a10cac9 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:14.230265 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2686a44d-e86a-48e6-a7fc-eb468a10cac9 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:14.230707 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2686a44d-e86a-48e6-a7fc-eb468a10cac9 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:14.393284 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-2686a44d-e86a-48e6-a7fc-eb468a10cac9 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:14.397013 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=94,nova_cell1:INSERT=3 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:14.402776 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-2686a44d-e86a-48e6-a7fc-eb468a10cac9 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5" status: 200 len: 1265 microversion: 2.1 time: 0.188952 Jul 28 04:06:14.403897 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 413/767] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:14 2022] GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:14.480467 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-53b45cbe-d2f3-498b-ab8e-d28e75ab61d8 req-60469ca6-a9db-4f7d-86c4-1dbba5c24f67 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "042cba62-5323-4dd0-9ad7-92ec0f0746c5", "tag": "9433ba71-4c92-4e59-94cf-c5886d010db8"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:14.494137 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-53b45cbe-d2f3-498b-ab8e-d28e75ab61d8 req-60469ca6-a9db-4f7d-86c4-1dbba5c24f67 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:14.496536 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-53b45cbe-d2f3-498b-ab8e-d28e75ab61d8 req-60469ca6-a9db-4f7d-86c4-1dbba5c24f67 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:14.512147 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-53b45cbe-d2f3-498b-ab8e-d28e75ab61d8 req-60469ca6-a9db-4f7d-86c4-1dbba5c24f67 service nova] Creating event network-changed:9433ba71-4c92-4e59-94cf-c5886d010db8 for instance 042cba62-5323-4dd0-9ad7-92ec0f0746c5 on hv-cinder-79987 Jul 28 04:06:14.526863 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-53b45cbe-d2f3-498b-ab8e-d28e75ab61d8 req-60469ca6-a9db-4f7d-86c4-1dbba5c24f67 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049877 Jul 28 04:06:14.528093 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 355/768] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:06:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:14.960187 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ec4a663e-fa41-4797-8fc5-140e07e12803 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:14.960690 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ec4a663e-fa41-4797-8fc5-140e07e12803 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:14.967882 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ec4a663e-fa41-4797-8fc5-140e07e12803 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:14.968331 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ec4a663e-fa41-4797-8fc5-140e07e12803 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:14.969114 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ec4a663e-fa41-4797-8fc5-140e07e12803 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:14.969637 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ec4a663e-fa41-4797-8fc5-140e07e12803 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:14.985551 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-ec4a663e-fa41-4797-8fc5-140e07e12803 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] HTTP exception thrown: Instance beb705c5-be1c-471d-82d9-b6d699ead475 could not be found. Jul 28 04:06:14.987154 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ec4a663e-fa41-4797-8fc5-140e07e12803 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Request method failure captured: Jul 28 04:06:14.987154 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: DELETE /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 HTTP/1.1 Jul 28 04:06:14.987154 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:06:14.987154 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:06:14.987154 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:06:14.987154 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:06:14.987154 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:06:14.987154 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:06:14.987154 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:06:14.987154 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:14.987154 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gmvBMnfb8DTsIkgUa4MflJw_khZbOOklb3o8cTO1OBAYvtXeo1m8PBQrIox6r8bSG9QniIJnr_VCAM_w9OH-_z8cUBrcSv_yuSahr6_6JdG10-UT9QXWIA4LQaualsr4hMi4wp8NV2iLgQWCinAWb8VHl11UjNolYlN6vUa5fspesg Jul 28 04:06:14.987154 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:06:14.987154 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:06:14.987154 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:06:14.987154 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:06:14.987154 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:06:14.987154 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:06:14.987154 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 5db0f08a14ac472fb3edf2107c9ccfc5 Jul 28 04:06:14.987154 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeTestJSON-403862681 Jul 28 04:06:14.987154 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:06:14.987154 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:06:14.988782 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5db0f08a14ac472fb3edf2107c9ccfc5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5db0f08a14ac472fb3edf2107c9ccfc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5db0f08a14ac472fb3edf2107c9ccfc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5db0f08a14ac472fb3edf2107c9ccfc5"}]}] Jul 28 04:06:14.988782 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeTestJSON-403862681 Jul 28 04:06:14.988782 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 5db0f08a14ac472fb3edf2107c9ccfc5 Jul 28 04:06:14.988782 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeTestJSON-403862681 Jul 28 04:06:14.988782 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeTestJSON-403862681-project Jul 28 04:06:14.988782 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:06:14.988782 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:06:14.988782 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: 7112379fb6794027a7c1519b2f77a5d4 Jul 28 04:06:14.988782 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeTestJSON-403862681-project Jul 28 04:06:14.988782 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:06:14.988782 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Instance beb705c5-be1c-471d-82d9-b6d699ead475 could not be found. Jul 28 04:06:14.988782 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': 'beb705c5-be1c-471d-82d9-b6d699ead475'} Jul 28 04:06:14.989590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:14.989590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:14.989590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:06:14.989590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:06:14.989590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:06:14.989590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:06:14.989590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:06:14.989590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:06:14.989590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:06:14.989590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:06:14.989590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beb705c5-be1c-471d-82d9-b6d699ead475 could not be found. Jul 28 04:06:14.989590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:14.989590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:14.989590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:14.989590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:14.989590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:14.989590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:14.989590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:14.989590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:14.989590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:14.991133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:14.991133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:06:14.991133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:06:14.991133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:06:14.991133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:06:14.991133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:06:14.991133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:06:14.991133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:06:14.991133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:06:14.991133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beb705c5-be1c-471d-82d9-b6d699ead475 could not be found. Jul 28 04:06:14.991133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:14.991133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:14.991133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:14.991133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:14.991133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:14.991133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:14.991133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:14.991133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:14.991133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beb705c5-be1c-471d-82d9-b6d699ead475 could not be found. Jul 28 04:06:14.991133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:14.992394 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ec4a663e-fa41-4797-8fc5-140e07e12803 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Returning 404 to user: Instance beb705c5-be1c-471d-82d9-b6d699ead475 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:14.992394 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ec4a663e-fa41-4797-8fc5-140e07e12803 tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "DELETE /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 404 len: 111 microversion: 2.1 time: 0.032340 Jul 28 04:06:14.992394 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 414/769] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:06:14 2022] DELETE /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:06:14.998362 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-1ea06aed-c2fc-4564-957a-045c79d5d4ba tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:14.999119 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-1ea06aed-c2fc-4564-957a-045c79d5d4ba tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] [instance: beb705c5-be1c-471d-82d9-b6d699ead475] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:15.006353 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1ea06aed-c2fc-4564-957a-045c79d5d4ba tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:15.006859 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1ea06aed-c2fc-4564-957a-045c79d5d4ba tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:15.007652 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1ea06aed-c2fc-4564-957a-045c79d5d4ba tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:15.008091 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1ea06aed-c2fc-4564-957a-045c79d5d4ba tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:15.022464 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.wsgi [None req-1ea06aed-c2fc-4564-957a-045c79d5d4ba tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] HTTP exception thrown: Instance beb705c5-be1c-471d-82d9-b6d699ead475 could not be found. Jul 28 04:06:15.024374 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-1ea06aed-c2fc-4564-957a-045c79d5d4ba tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Request method failure captured: Jul 28 04:06:15.024374 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: request: GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 HTTP/1.1 Jul 28 04:06:15.024374 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept: application/json Jul 28 04:06:15.024374 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept-Encoding: identity Jul 28 04:06:15.024374 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Connection: close Jul 28 04:06:15.024374 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Length: 0 Jul 28 04:06:15.024374 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Type: application/json Jul 28 04:06:15.024374 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Host: 10.222.0.46 Jul 28 04:06:15.024374 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Openstack-System-Scope: None Jul 28 04:06:15.024374 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:15.024374 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Auth-Token: gAAAAABi4gmvBMnfb8DTsIkgUa4MflJw_khZbOOklb3o8cTO1OBAYvtXeo1m8PBQrIox6r8bSG9QniIJnr_VCAM_w9OH-_z8cUBrcSv_yuSahr6_6JdG10-UT9QXWIA4LQaualsr4hMi4wp8NV2iLgQWCinAWb8VHl11UjNolYlN6vUa5fspesg Jul 28 04:06:15.024374 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Id: None Jul 28 04:06:15.024374 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Name: None Jul 28 04:06:15.024374 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Identity-Status: Confirmed Jul 28 04:06:15.024374 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Is-Admin-Project: True Jul 28 04:06:15.024374 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Id: default Jul 28 04:06:15.024374 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Name: Default Jul 28 04:06:15.024374 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Id: 5db0f08a14ac472fb3edf2107c9ccfc5 Jul 28 04:06:15.024374 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Name: tempest-AttachVolumeTestJSON-403862681 Jul 28 04:06:15.024374 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Role: reader,member Jul 28 04:06:15.024374 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Roles: reader,member Jul 28 04:06:15.025977 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_5db0f08a14ac472fb3edf2107c9ccfc5", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5db0f08a14ac472fb3edf2107c9ccfc5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/5db0f08a14ac472fb3edf2107c9ccfc5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/5db0f08a14ac472fb3edf2107c9ccfc5"}]}] Jul 28 04:06:15.025977 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant: tempest-AttachVolumeTestJSON-403862681 Jul 28 04:06:15.025977 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Id: 5db0f08a14ac472fb3edf2107c9ccfc5 Jul 28 04:06:15.025977 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Name: tempest-AttachVolumeTestJSON-403862681 Jul 28 04:06:15.025977 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User: tempest-AttachVolumeTestJSON-403862681-project Jul 28 04:06:15.025977 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Id: default Jul 28 04:06:15.025977 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Name: Default Jul 28 04:06:15.025977 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Id: 7112379fb6794027a7c1519b2f77a5d4 Jul 28 04:06:15.025977 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Name: tempest-AttachVolumeTestJSON-403862681-project Jul 28 04:06:15.025977 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: method: > Jul 28 04:06:15.025977 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: exception: Instance beb705c5-be1c-471d-82d9-b6d699ead475 could not be found. Jul 28 04:06:15.025977 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: action_args: {'id': 'beb705c5-be1c-471d-82d9-b6d699ead475'} Jul 28 04:06:15.027007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:15.027007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:15.027007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:06:15.027007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:06:15.027007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:06:15.027007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:06:15.027007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:06:15.027007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:06:15.027007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:06:15.027007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:06:15.027007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance beb705c5-be1c-471d-82d9-b6d699ead475 could not be found. Jul 28 04:06:15.027007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:15.027007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:15.027007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:15.027007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:15.027007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:15.027007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:15.027007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:15.027007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:15.027007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:15.028413 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:15.028413 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:06:15.028413 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:06:15.028413 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:06:15.028413 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:06:15.028413 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:06:15.028413 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:06:15.028413 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance beb705c5-be1c-471d-82d9-b6d699ead475 could not be found. Jul 28 04:06:15.028413 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:15.028413 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:15.028413 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:15.028413 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:15.028413 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:15.028413 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:15.028413 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:15.028413 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:15.028413 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance beb705c5-be1c-471d-82d9-b6d699ead475 could not be found. Jul 28 04:06:15.028413 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:15.029714 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-1ea06aed-c2fc-4564-957a-045c79d5d4ba tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] Returning 404 to user: Instance beb705c5-be1c-471d-82d9-b6d699ead475 could not be found. {{(pid=118186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:15.029714 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-1ea06aed-c2fc-4564-957a-045c79d5d4ba tempest-AttachVolumeTestJSON-403862681 tempest-AttachVolumeTestJSON-403862681-project] 10.222.0.46 "GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475" status: 404 len: 111 microversion: 2.1 time: 0.032230 Jul 28 04:06:15.029714 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 356/770] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:14 2022] GET /compute/v2.1/servers/beb705c5-be1c-471d-82d9-b6d699ead475 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:06:15.424646 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ef1e12d3-0847-4a2d-ba63-ad66865b7124 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:15.425397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ef1e12d3-0847-4a2d-ba63-ad66865b7124 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 042cba62-5323-4dd0-9ad7-92ec0f0746c5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:15.433200 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ef1e12d3-0847-4a2d-ba63-ad66865b7124 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:15.433651 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ef1e12d3-0847-4a2d-ba63-ad66865b7124 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:15.434418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ef1e12d3-0847-4a2d-ba63-ad66865b7124 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:15.434876 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ef1e12d3-0847-4a2d-ba63-ad66865b7124 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:15.659893 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ef1e12d3-0847-4a2d-ba63-ad66865b7124 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:15.669523 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ef1e12d3-0847-4a2d-ba63-ad66865b7124 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5" status: 200 len: 1265 microversion: 2.1 time: 0.249001 Jul 28 04:06:15.670124 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 415/771] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:15 2022] GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5 => generated 1265 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:16.691343 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-4def47a1-fa78-4d1d-9e5a-2f139ca8e84b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:16.692051 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-4def47a1-fa78-4d1d-9e5a-2f139ca8e84b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 042cba62-5323-4dd0-9ad7-92ec0f0746c5] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:16.698528 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4def47a1-fa78-4d1d-9e5a-2f139ca8e84b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:16.699081 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4def47a1-fa78-4d1d-9e5a-2f139ca8e84b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:16.699912 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4def47a1-fa78-4d1d-9e5a-2f139ca8e84b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:16.700419 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4def47a1-fa78-4d1d-9e5a-2f139ca8e84b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:16.855835 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-4def47a1-fa78-4d1d-9e5a-2f139ca8e84b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:16.864303 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-4def47a1-fa78-4d1d-9e5a-2f139ca8e84b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5" status: 200 len: 1265 microversion: 2.1 time: 0.177566 Jul 28 04:06:16.864882 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 357/772] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:16 2022] GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5 => generated 1265 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:17.885425 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7df2f223-a293-4b10-b310-6ed47549a786 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:17.886049 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7df2f223-a293-4b10-b310-6ed47549a786 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 042cba62-5323-4dd0-9ad7-92ec0f0746c5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:17.888661 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:17.894834 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7df2f223-a293-4b10-b310-6ed47549a786 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:17.895494 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7df2f223-a293-4b10-b310-6ed47549a786 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:17.896282 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7df2f223-a293-4b10-b310-6ed47549a786 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:17.896723 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7df2f223-a293-4b10-b310-6ed47549a786 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:18.055938 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7df2f223-a293-4b10-b310-6ed47549a786 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:18.064675 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7df2f223-a293-4b10-b310-6ed47549a786 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5" status: 200 len: 1265 microversion: 2.1 time: 0.183037 Jul 28 04:06:18.066832 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 416/773] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:17 2022] GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5 => generated 1265 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:19.086349 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-e4273bb9-3979-479c-a2af-42824c31a85b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:19.087012 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-e4273bb9-3979-479c-a2af-42824c31a85b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 042cba62-5323-4dd0-9ad7-92ec0f0746c5] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:19.093296 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e4273bb9-3979-479c-a2af-42824c31a85b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:19.093756 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e4273bb9-3979-479c-a2af-42824c31a85b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:19.094631 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e4273bb9-3979-479c-a2af-42824c31a85b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:19.095208 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e4273bb9-3979-479c-a2af-42824c31a85b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:19.249947 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-e4273bb9-3979-479c-a2af-42824c31a85b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:19.258327 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-e4273bb9-3979-479c-a2af-42824c31a85b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5" status: 200 len: 1265 microversion: 2.1 time: 0.176381 Jul 28 04:06:19.272167 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 358/774] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:19 2022] GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5 => generated 1265 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:20.255412 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-1f0b1d08-7e37-458b-b9f9-cdf84c56854e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:20.255919 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-1f0b1d08-7e37-458b-b9f9-cdf84c56854e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:20.263042 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1f0b1d08-7e37-458b-b9f9-cdf84c56854e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:20.263714 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1f0b1d08-7e37-458b-b9f9-cdf84c56854e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:20.264496 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1f0b1d08-7e37-458b-b9f9-cdf84c56854e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:20.264957 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1f0b1d08-7e37-458b-b9f9-cdf84c56854e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:20.278671 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-23d4f916-394a-4748-b478-c0755efaa87e tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:20.279394 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-23d4f916-394a-4748-b478-c0755efaa87e tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 042cba62-5323-4dd0-9ad7-92ec0f0746c5] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:20.282537 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=52 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:20.296736 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-23d4f916-394a-4748-b478-c0755efaa87e tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:20.297475 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-23d4f916-394a-4748-b478-c0755efaa87e tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:20.298495 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-23d4f916-394a-4748-b478-c0755efaa87e tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:20.299231 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-23d4f916-394a-4748-b478-c0755efaa87e tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:20.303990 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:20.362459 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.objects.instance [None req-1f0b1d08-7e37-458b-b9f9-cdf84c56854e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lazy-loading 'services' on Instance uuid d70dec9a-dc79-4378-b2d4-f22ef6956150 {{(pid=118187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:06:20.444917 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-1f0b1d08-7e37-458b-b9f9-cdf84c56854e tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150/os-volume_attachments/667838c2-c8cd-46fb-8a7d-538d76f7b91a" status: 202 len: 0 microversion: 2.1 time: 0.193285 Jul 28 04:06:20.445519 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 417/775] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Jul 28 04:06:20 2022] DELETE /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150/os-volume_attachments/667838c2-c8cd-46fb-8a7d-538d76f7b91a => generated 0 bytes in 195 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:06:20.454805 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5f4a4c3b-e549-4917-80e9-e10445855090 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:20.457097 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-23d4f916-394a-4748-b478-c0755efaa87e tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:20.457808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5f4a4c3b-e549-4917-80e9-e10445855090 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:20.465285 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f4a4c3b-e549-4917-80e9-e10445855090 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:20.465737 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f4a4c3b-e549-4917-80e9-e10445855090 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:20.466656 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f4a4c3b-e549-4917-80e9-e10445855090 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:20.467130 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5f4a4c3b-e549-4917-80e9-e10445855090 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:20.470312 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-23d4f916-394a-4748-b478-c0755efaa87e tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5" status: 200 len: 1265 microversion: 2.1 time: 0.195453 Jul 28 04:06:20.471368 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 359/776] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:20 2022] GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5 => generated 1265 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:06:20.500138 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5f4a4c3b-e549-4917-80e9-e10445855090 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049727 Jul 28 04:06:20.501312 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 418/777] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Jul 28 04:06:20 2022] GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:21.494007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-0d94c5e4-11ae-48df-bed6-7b93aaa6056a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:21.494007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-0d94c5e4-11ae-48df-bed6-7b93aaa6056a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 042cba62-5323-4dd0-9ad7-92ec0f0746c5] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:21.499703 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0d94c5e4-11ae-48df-bed6-7b93aaa6056a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:21.500166 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0d94c5e4-11ae-48df-bed6-7b93aaa6056a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:21.501214 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0d94c5e4-11ae-48df-bed6-7b93aaa6056a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:21.501662 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0d94c5e4-11ae-48df-bed6-7b93aaa6056a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:21.513401 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-30d6e0df-c5c7-4f5e-a186-9327d246554a tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:21.515737 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-30d6e0df-c5c7-4f5e-a186-9327d246554a tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:21.523036 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-30d6e0df-c5c7-4f5e-a186-9327d246554a tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:21.523487 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-30d6e0df-c5c7-4f5e-a186-9327d246554a tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:21.524417 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-30d6e0df-c5c7-4f5e-a186-9327d246554a tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:21.524857 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-30d6e0df-c5c7-4f5e-a186-9327d246554a tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:21.558587 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-30d6e0df-c5c7-4f5e-a186-9327d246554a tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049662 Jul 28 04:06:21.559397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 419/778] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Jul 28 04:06:21 2022] GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:06:21.659526 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-0d94c5e4-11ae-48df-bed6-7b93aaa6056a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:21.668848 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-0d94c5e4-11ae-48df-bed6-7b93aaa6056a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5" status: 200 len: 1265 microversion: 2.1 time: 0.180479 Jul 28 04:06:21.669886 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 360/779] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:21 2022] GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:22.571053 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c5051ca3-2c42-4efa-af3b-cdddb9282cb4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:22.573215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c5051ca3-2c42-4efa-af3b-cdddb9282cb4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:22.575241 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:22.575939 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=6 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:22.583305 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c5051ca3-2c42-4efa-af3b-cdddb9282cb4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:22.583794 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c5051ca3-2c42-4efa-af3b-cdddb9282cb4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:22.584580 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c5051ca3-2c42-4efa-af3b-cdddb9282cb4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:22.585021 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c5051ca3-2c42-4efa-af3b-cdddb9282cb4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:22.621648 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c5051ca3-2c42-4efa-af3b-cdddb9282cb4 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.054559 Jul 28 04:06:22.622135 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 420/780] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Jul 28 04:06:22 2022] GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150/os-volume_attachments => generated 25 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:06:22.686316 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-e3732dec-77f2-41bc-9944-f10577ac2e94 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:22.686316 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-e3732dec-77f2-41bc-9944-f10577ac2e94 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:22.689148 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell0:SELECT=2 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:22.692068 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-35df008c-08f1-4cd4-b896-742d062f1515 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:22.692758 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-35df008c-08f1-4cd4-b896-742d062f1515 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 042cba62-5323-4dd0-9ad7-92ec0f0746c5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:22.694008 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e3732dec-77f2-41bc-9944-f10577ac2e94 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:22.694462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e3732dec-77f2-41bc-9944-f10577ac2e94 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:22.695280 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e3732dec-77f2-41bc-9944-f10577ac2e94 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:22.695703 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e3732dec-77f2-41bc-9944-f10577ac2e94 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:22.699721 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-35df008c-08f1-4cd4-b896-742d062f1515 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:22.700173 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-35df008c-08f1-4cd4-b896-742d062f1515 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:22.700938 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-35df008c-08f1-4cd4-b896-742d062f1515 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:22.701366 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-35df008c-08f1-4cd4-b896-742d062f1515 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:22.721598 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-e3732dec-77f2-41bc-9944-f10577ac2e94 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Going to try to terminate instance {{(pid=118186) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:06:22.816339 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-e3732dec-77f2-41bc-9944-f10577ac2e94 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150" status: 204 len: 0 microversion: 2.1 time: 0.135130 Jul 28 04:06:22.816888 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 361/781] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:06:22 2022] DELETE /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:06:22.825724 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-74d718f2-d464-4ac3-8619-afbfffa1abdd tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:22.826724 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-74d718f2-d464-4ac3-8619-afbfffa1abdd tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:22.833875 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-74d718f2-d464-4ac3-8619-afbfffa1abdd tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:22.834407 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-74d718f2-d464-4ac3-8619-afbfffa1abdd tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:22.835293 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-74d718f2-d464-4ac3-8619-afbfffa1abdd tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:22.835810 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-74d718f2-d464-4ac3-8619-afbfffa1abdd tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:22.845018 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-35df008c-08f1-4cd4-b896-742d062f1515 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:22.853059 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-35df008c-08f1-4cd4-b896-742d062f1515 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5" status: 200 len: 1265 microversion: 2.1 time: 0.166454 Jul 28 04:06:22.853949 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 421/782] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:22 2022] GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5 => generated 1265 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:06:22.972642 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-74d718f2-d464-4ac3-8619-afbfffa1abdd tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:22.980352 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-74d718f2-d464-4ac3-8619-afbfffa1abdd tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150" status: 200 len: 1680 microversion: 2.1 time: 0.158943 Jul 28 04:06:22.980855 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 362/783] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:22 2022] GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150 => generated 1680 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:23.874005 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8728e8e2-d3d1-4eb1-b1cf-ed2e3b5182c3 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:23.874635 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8728e8e2-d3d1-4eb1-b1cf-ed2e3b5182c3 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 042cba62-5323-4dd0-9ad7-92ec0f0746c5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:23.881946 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8728e8e2-d3d1-4eb1-b1cf-ed2e3b5182c3 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:23.882462 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8728e8e2-d3d1-4eb1-b1cf-ed2e3b5182c3 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:23.883366 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8728e8e2-d3d1-4eb1-b1cf-ed2e3b5182c3 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:23.883886 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8728e8e2-d3d1-4eb1-b1cf-ed2e3b5182c3 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:24.002655 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c0ea86c0-629a-425a-aa9e-b8d5e8f7ce4d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:24.003957 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c0ea86c0-629a-425a-aa9e-b8d5e8f7ce4d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:24.011570 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c0ea86c0-629a-425a-aa9e-b8d5e8f7ce4d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:24.012030 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c0ea86c0-629a-425a-aa9e-b8d5e8f7ce4d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:24.012818 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c0ea86c0-629a-425a-aa9e-b8d5e8f7ce4d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:24.013260 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c0ea86c0-629a-425a-aa9e-b8d5e8f7ce4d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:24.022121 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8728e8e2-d3d1-4eb1-b1cf-ed2e3b5182c3 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:24.029635 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8728e8e2-d3d1-4eb1-b1cf-ed2e3b5182c3 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5" status: 200 len: 1265 microversion: 2.1 time: 0.159898 Jul 28 04:06:24.030202 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 422/784] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:23 2022] GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:24.147063 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-c0ea86c0-629a-425a-aa9e-b8d5e8f7ce4d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:24.154585 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-c0ea86c0-629a-425a-aa9e-b8d5e8f7ce4d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150" status: 200 len: 1680 microversion: 2.1 time: 0.156851 Jul 28 04:06:24.155177 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 363/785] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:23 2022] GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150 => generated 1680 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:06:25.054670 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-0b8d8942-7440-4c36-9ba9-6f88fedfea01 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:25.055921 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-0b8d8942-7440-4c36-9ba9-6f88fedfea01 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 042cba62-5323-4dd0-9ad7-92ec0f0746c5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:25.066900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0b8d8942-7440-4c36-9ba9-6f88fedfea01 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:25.067603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0b8d8942-7440-4c36-9ba9-6f88fedfea01 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:25.068606 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0b8d8942-7440-4c36-9ba9-6f88fedfea01 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:25.069252 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0b8d8942-7440-4c36-9ba9-6f88fedfea01 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:25.178472 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-8cefdac9-0de7-4e5b-a141-e693838c4193 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:25.179764 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-8cefdac9-0de7-4e5b-a141-e693838c4193 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:25.189697 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8cefdac9-0de7-4e5b-a141-e693838c4193 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:25.191170 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8cefdac9-0de7-4e5b-a141-e693838c4193 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:25.191991 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8cefdac9-0de7-4e5b-a141-e693838c4193 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:25.192803 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8cefdac9-0de7-4e5b-a141-e693838c4193 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:25.241655 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-0b8d8942-7440-4c36-9ba9-6f88fedfea01 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:25.250817 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-0b8d8942-7440-4c36-9ba9-6f88fedfea01 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5" status: 200 len: 1265 microversion: 2.1 time: 0.200267 Jul 28 04:06:25.251544 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 423/786] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:25 2022] GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:25.285701 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-8cefdac9-0de7-4e5b-a141-e693838c4193 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3308761e9d2495e95e127bbc7b9c5e2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a927e9f5da42d7b34752c8b2db211a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:25.297917 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-8cefdac9-0de7-4e5b-a141-e693838c4193 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150" status: 200 len: 1612 microversion: 2.1 time: 0.123384 Jul 28 04:06:25.299204 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 364/787] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:25 2022] GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150 => generated 1612 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:06:25.475354 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-59045514-d2b2-4a3e-b933-2d464e961da4 req-090297c0-3b03-4dcf-94c5-17192b1c7b8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d70dec9a-dc79-4378-b2d4-f22ef6956150", "name": "network-vif-deleted", "tag": "2c66d8b1-20de-418e-9326-ed59dd9997bb"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:25.505134 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-59045514-d2b2-4a3e-b933-2d464e961da4 req-090297c0-3b03-4dcf-94c5-17192b1c7b8c service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:25.505588 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-59045514-d2b2-4a3e-b933-2d464e961da4 req-090297c0-3b03-4dcf-94c5-17192b1c7b8c service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:25.531191 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-59045514-d2b2-4a3e-b933-2d464e961da4 req-090297c0-3b03-4dcf-94c5-17192b1c7b8c service nova] Creating event network-vif-deleted:2c66d8b1-20de-418e-9326-ed59dd9997bb for instance d70dec9a-dc79-4378-b2d4-f22ef6956150 on hv-cinder-79987 Jul 28 04:06:25.540854 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-59045514-d2b2-4a3e-b933-2d464e961da4 req-090297c0-3b03-4dcf-94c5-17192b1c7b8c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.069024 Jul 28 04:06:25.541672 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 424/788] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:25.952325 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-c2489e18-44fb-468a-8a7b-01f1101303f1 req-1c2e25f4-f30a-45b2-8e21-60f7b907baee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "042cba62-5323-4dd0-9ad7-92ec0f0746c5", "name": "network-vif-plugged", "status": "completed", "tag": "9433ba71-4c92-4e59-94cf-c5886d010db8"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:25.965858 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-c2489e18-44fb-468a-8a7b-01f1101303f1 req-1c2e25f4-f30a-45b2-8e21-60f7b907baee service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:25.966312 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-c2489e18-44fb-468a-8a7b-01f1101303f1 req-1c2e25f4-f30a-45b2-8e21-60f7b907baee service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:25.981094 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-c2489e18-44fb-468a-8a7b-01f1101303f1 req-1c2e25f4-f30a-45b2-8e21-60f7b907baee service nova] Creating event network-vif-plugged:9433ba71-4c92-4e59-94cf-c5886d010db8 for instance 042cba62-5323-4dd0-9ad7-92ec0f0746c5 on hv-cinder-79987 Jul 28 04:06:25.988188 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-c2489e18-44fb-468a-8a7b-01f1101303f1 req-1c2e25f4-f30a-45b2-8e21-60f7b907baee service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039587 Jul 28 04:06:25.991770 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 365/789] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:06:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:26.274641 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c944b460-2e6e-48e9-a3d1-95bf3ec20c36 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:26.275370 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c944b460-2e6e-48e9-a3d1-95bf3ec20c36 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 042cba62-5323-4dd0-9ad7-92ec0f0746c5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:26.282329 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c944b460-2e6e-48e9-a3d1-95bf3ec20c36 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:26.283086 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c944b460-2e6e-48e9-a3d1-95bf3ec20c36 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:26.284065 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c944b460-2e6e-48e9-a3d1-95bf3ec20c36 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:26.284664 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c944b460-2e6e-48e9-a3d1-95bf3ec20c36 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:26.322625 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-334b12a0-1cf8-455f-8187-e4bafd074227 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:26.323476 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-334b12a0-1cf8-455f-8187-e4bafd074227 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:26.330247 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-334b12a0-1cf8-455f-8187-e4bafd074227 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:26.330881 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-334b12a0-1cf8-455f-8187-e4bafd074227 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:26.331725 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-334b12a0-1cf8-455f-8187-e4bafd074227 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:26.332375 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-334b12a0-1cf8-455f-8187-e4bafd074227 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:26.352906 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.wsgi [None req-334b12a0-1cf8-455f-8187-e4bafd074227 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] HTTP exception thrown: Instance d70dec9a-dc79-4378-b2d4-f22ef6956150 could not be found. Jul 28 04:06:26.354723 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-334b12a0-1cf8-455f-8187-e4bafd074227 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Request method failure captured: Jul 28 04:06:26.354723 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: request: GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150 HTTP/1.1 Jul 28 04:06:26.354723 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept: application/json Jul 28 04:06:26.354723 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept-Encoding: identity Jul 28 04:06:26.354723 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Connection: close Jul 28 04:06:26.354723 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Length: 0 Jul 28 04:06:26.354723 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Type: application/json Jul 28 04:06:26.354723 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Host: 10.222.0.46 Jul 28 04:06:26.354723 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Openstack-System-Scope: None Jul 28 04:06:26.354723 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:26.354723 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Auth-Token: gAAAAABi4gmoXQtNoyNZeVOBtHeH0p0IZl6gLmXu7uMplYaqMcIU3TXk6NAztCb7-3xvXPbqffriel8JQiqKAHgD2FYfvE1RoXCiUMTvpIZjixGVtBiBXhQr6lOIK0tmH4bMvCgHENHbbkhJpWpz1XJYt5CJBH3JqJi5ypO8pp_YsE0VFSnKOUI Jul 28 04:06:26.354723 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Id: None Jul 28 04:06:26.354723 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Name: None Jul 28 04:06:26.354723 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Identity-Status: Confirmed Jul 28 04:06:26.354723 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Is-Admin-Project: True Jul 28 04:06:26.354723 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Id: default Jul 28 04:06:26.354723 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Name: Default Jul 28 04:06:26.354723 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:06:26.354723 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:26.354723 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Role: reader,member Jul 28 04:06:26.354723 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Roles: reader,member Jul 28 04:06:26.356613 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_18a927e9f5da42d7b34752c8b2db211a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/18a927e9f5da42d7b34752c8b2db211a"}]}] Jul 28 04:06:26.356613 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:26.356613 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:06:26.356613 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:26.356613 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:06:26.356613 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Id: default Jul 28 04:06:26.356613 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Name: Default Jul 28 04:06:26.356613 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Id: c3308761e9d2495e95e127bbc7b9c5e2 Jul 28 04:06:26.356613 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Name: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:06:26.356613 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: method: > Jul 28 04:06:26.356613 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: exception: Instance d70dec9a-dc79-4378-b2d4-f22ef6956150 could not be found. Jul 28 04:06:26.356613 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: action_args: {'id': 'd70dec9a-dc79-4378-b2d4-f22ef6956150'} Jul 28 04:06:26.357562 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:26.357562 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:26.357562 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:06:26.357562 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:06:26.357562 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:06:26.357562 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:06:26.357562 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:06:26.357562 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:06:26.357562 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:06:26.357562 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:06:26.357562 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d70dec9a-dc79-4378-b2d4-f22ef6956150 could not be found. Jul 28 04:06:26.357562 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:26.357562 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:26.357562 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:26.357562 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:26.357562 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:26.357562 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:26.357562 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:26.357562 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:26.357562 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:26.359968 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:26.359968 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:06:26.359968 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:06:26.359968 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:06:26.359968 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:06:26.359968 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:06:26.359968 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:06:26.359968 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d70dec9a-dc79-4378-b2d4-f22ef6956150 could not be found. Jul 28 04:06:26.359968 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:26.359968 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:26.359968 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:26.359968 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:26.359968 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:26.359968 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:26.359968 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:26.359968 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:26.359968 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d70dec9a-dc79-4378-b2d4-f22ef6956150 could not be found. Jul 28 04:06:26.359968 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:26.361957 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-334b12a0-1cf8-455f-8187-e4bafd074227 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Returning 404 to user: Instance d70dec9a-dc79-4378-b2d4-f22ef6956150 could not be found. {{(pid=118186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:26.361957 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-334b12a0-1cf8-455f-8187-e4bafd074227 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150" status: 404 len: 111 microversion: 2.1 time: 0.041395 Jul 28 04:06:26.364901 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 366/790] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:26 2022] GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:06:26.370999 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-d2dd8caf-ae80-4771-92e3-d9e1cc2d158d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '.version_select at 0x7fa6ee09fa60>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:26.395511 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-d2dd8caf-ae80-4771-92e3-d9e1cc2d158d tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-812196330" status: 202 len: 0 microversion: 2.1 time: 0.028810 Jul 28 04:06:26.396388 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 367/791] 10.222.0.46 () {58 vars in 1218 bytes} [Thu Jul 28 04:06:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-812196330 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:06:26.492568 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c944b460-2e6e-48e9-a3d1-95bf3ec20c36 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:26.501888 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c944b460-2e6e-48e9-a3d1-95bf3ec20c36 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5" status: 200 len: 1265 microversion: 2.1 time: 0.231622 Jul 28 04:06:26.516398 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 425/792] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:26 2022] GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5 => generated 1265 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:27.523438 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-9e52405f-5a56-4fb6-abe7-954dd96db638 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:27.524068 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-9e52405f-5a56-4fb6-abe7-954dd96db638 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 042cba62-5323-4dd0-9ad7-92ec0f0746c5] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:27.531264 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9e52405f-5a56-4fb6-abe7-954dd96db638 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:27.531726 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9e52405f-5a56-4fb6-abe7-954dd96db638 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:27.532507 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9e52405f-5a56-4fb6-abe7-954dd96db638 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:27.533124 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9e52405f-5a56-4fb6-abe7-954dd96db638 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:27.729767 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-9e52405f-5a56-4fb6-abe7-954dd96db638 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:27.738860 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-9e52405f-5a56-4fb6-abe7-954dd96db638 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5" status: 200 len: 1452 microversion: 2.1 time: 0.219789 Jul 28 04:06:27.739363 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 368/793] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:27 2022] GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5 => generated 1452 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:27.760820 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-0b20860c-42e1-414b-8a12-baa02bcf391f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:27.761570 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-0b20860c-42e1-414b-8a12-baa02bcf391f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 042cba62-5323-4dd0-9ad7-92ec0f0746c5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:27.769346 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0b20860c-42e1-414b-8a12-baa02bcf391f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:27.769799 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0b20860c-42e1-414b-8a12-baa02bcf391f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:27.770572 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0b20860c-42e1-414b-8a12-baa02bcf391f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:27.771034 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0b20860c-42e1-414b-8a12-baa02bcf391f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:27.927232 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-0b20860c-42e1-414b-8a12-baa02bcf391f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:27.935003 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-0b20860c-42e1-414b-8a12-baa02bcf391f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5" status: 200 len: 1452 microversion: 2.1 time: 0.178541 Jul 28 04:06:27.935800 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 426/794] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:27 2022] GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5 => generated 1452 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:28.336920 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-9a630666-2b5a-4471-9f6a-c0bc28631feb tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:28.337424 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-9a630666-2b5a-4471-9f6a-c0bc28631feb tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:28.343561 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9a630666-2b5a-4471-9f6a-c0bc28631feb tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:28.344710 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9a630666-2b5a-4471-9f6a-c0bc28631feb tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:28.345504 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9a630666-2b5a-4471-9f6a-c0bc28631feb tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:28.346164 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9a630666-2b5a-4471-9f6a-c0bc28631feb tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:28.361859 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.wsgi [None req-9a630666-2b5a-4471-9f6a-c0bc28631feb tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] HTTP exception thrown: Instance d70dec9a-dc79-4378-b2d4-f22ef6956150 could not be found. Jul 28 04:06:28.363951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-9a630666-2b5a-4471-9f6a-c0bc28631feb tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Request method failure captured: Jul 28 04:06:28.363951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: request: DELETE /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150 HTTP/1.1 Jul 28 04:06:28.363951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept: application/json Jul 28 04:06:28.363951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept-Encoding: identity Jul 28 04:06:28.363951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Connection: close Jul 28 04:06:28.363951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Length: 0 Jul 28 04:06:28.363951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Type: application/json Jul 28 04:06:28.363951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Host: 10.222.0.46 Jul 28 04:06:28.363951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Openstack-System-Scope: None Jul 28 04:06:28.363951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:28.363951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Auth-Token: gAAAAABi4gmoXQtNoyNZeVOBtHeH0p0IZl6gLmXu7uMplYaqMcIU3TXk6NAztCb7-3xvXPbqffriel8JQiqKAHgD2FYfvE1RoXCiUMTvpIZjixGVtBiBXhQr6lOIK0tmH4bMvCgHENHbbkhJpWpz1XJYt5CJBH3JqJi5ypO8pp_YsE0VFSnKOUI Jul 28 04:06:28.363951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Id: None Jul 28 04:06:28.363951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Name: None Jul 28 04:06:28.363951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Identity-Status: Confirmed Jul 28 04:06:28.363951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Is-Admin-Project: True Jul 28 04:06:28.363951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Id: default Jul 28 04:06:28.363951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Name: Default Jul 28 04:06:28.363951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:06:28.363951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:28.363951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Role: reader,member Jul 28 04:06:28.363951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Roles: reader,member Jul 28 04:06:28.365568 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_18a927e9f5da42d7b34752c8b2db211a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/18a927e9f5da42d7b34752c8b2db211a"}]}] Jul 28 04:06:28.365568 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:28.365568 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:06:28.365568 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:28.365568 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:06:28.365568 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Id: default Jul 28 04:06:28.365568 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Name: Default Jul 28 04:06:28.365568 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Id: c3308761e9d2495e95e127bbc7b9c5e2 Jul 28 04:06:28.365568 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Name: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:06:28.365568 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: method: > Jul 28 04:06:28.365568 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: exception: Instance d70dec9a-dc79-4378-b2d4-f22ef6956150 could not be found. Jul 28 04:06:28.365568 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: action_args: {'id': 'd70dec9a-dc79-4378-b2d4-f22ef6956150'} Jul 28 04:06:28.366387 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:28.366387 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:28.366387 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:06:28.366387 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:06:28.366387 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:06:28.366387 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:06:28.366387 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:06:28.366387 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:06:28.366387 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:06:28.366387 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:06:28.366387 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d70dec9a-dc79-4378-b2d4-f22ef6956150 could not be found. Jul 28 04:06:28.366387 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:28.366387 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:28.366387 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:28.366387 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:28.366387 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:28.366387 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:28.366387 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:28.366387 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:28.366387 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:28.367687 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:28.367687 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:06:28.367687 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:06:28.367687 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:06:28.367687 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:06:28.367687 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:06:28.367687 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:06:28.367687 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:06:28.367687 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:06:28.367687 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d70dec9a-dc79-4378-b2d4-f22ef6956150 could not be found. Jul 28 04:06:28.367687 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:28.367687 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:28.367687 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:28.367687 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:28.367687 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:28.367687 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:28.367687 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:28.367687 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:28.367687 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d70dec9a-dc79-4378-b2d4-f22ef6956150 could not be found. Jul 28 04:06:28.367687 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:28.370525 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-9a630666-2b5a-4471-9f6a-c0bc28631feb tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Returning 404 to user: Instance d70dec9a-dc79-4378-b2d4-f22ef6956150 could not be found. {{(pid=118186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:28.371728 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-9a630666-2b5a-4471-9f6a-c0bc28631feb tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "DELETE /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150" status: 404 len: 111 microversion: 2.1 time: 0.038823 Jul 28 04:06:28.375038 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 369/795] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:06:28 2022] DELETE /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:06:28.382048 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8d2a8ee3-84d9-4957-9be1-3745e585e049 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:28.382671 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8d2a8ee3-84d9-4957-9be1-3745e585e049 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: d70dec9a-dc79-4378-b2d4-f22ef6956150] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:28.393323 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8d2a8ee3-84d9-4957-9be1-3745e585e049 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:28.393785 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8d2a8ee3-84d9-4957-9be1-3745e585e049 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:28.394557 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8d2a8ee3-84d9-4957-9be1-3745e585e049 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:28.395208 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8d2a8ee3-84d9-4957-9be1-3745e585e049 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:28.424426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-8d2a8ee3-84d9-4957-9be1-3745e585e049 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] HTTP exception thrown: Instance d70dec9a-dc79-4378-b2d4-f22ef6956150 could not be found. Jul 28 04:06:28.444097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8d2a8ee3-84d9-4957-9be1-3745e585e049 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Request method failure captured: Jul 28 04:06:28.444097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150 HTTP/1.1 Jul 28 04:06:28.444097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:06:28.444097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:06:28.444097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:06:28.444097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:06:28.444097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:06:28.444097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:06:28.444097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:06:28.444097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:28.444097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gmoXQtNoyNZeVOBtHeH0p0IZl6gLmXu7uMplYaqMcIU3TXk6NAztCb7-3xvXPbqffriel8JQiqKAHgD2FYfvE1RoXCiUMTvpIZjixGVtBiBXhQr6lOIK0tmH4bMvCgHENHbbkhJpWpz1XJYt5CJBH3JqJi5ypO8pp_YsE0VFSnKOUI Jul 28 04:06:28.444097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:06:28.444097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:06:28.444097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:06:28.444097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:06:28.444097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:06:28.444097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:06:28.444097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:06:28.444097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:28.444097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:06:28.444097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:06:28.445832 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_18a927e9f5da42d7b34752c8b2db211a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/18a927e9f5da42d7b34752c8b2db211a"}]}] Jul 28 04:06:28.445832 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:28.445832 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:06:28.445832 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:28.445832 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:06:28.445832 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:06:28.445832 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:06:28.445832 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: c3308761e9d2495e95e127bbc7b9c5e2 Jul 28 04:06:28.445832 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:06:28.445832 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:06:28.445832 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Instance d70dec9a-dc79-4378-b2d4-f22ef6956150 could not be found. Jul 28 04:06:28.445832 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': 'd70dec9a-dc79-4378-b2d4-f22ef6956150'} Jul 28 04:06:28.446645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:28.446645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:28.446645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:06:28.446645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:06:28.446645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:06:28.446645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:06:28.446645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:06:28.446645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:06:28.446645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:06:28.446645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:06:28.446645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d70dec9a-dc79-4378-b2d4-f22ef6956150 could not be found. Jul 28 04:06:28.446645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:28.446645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:28.446645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:28.446645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:28.446645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:28.446645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:28.446645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:28.446645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:28.446645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:28.448248 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:28.448248 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:06:28.448248 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:06:28.448248 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:06:28.448248 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:06:28.448248 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:06:28.448248 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:06:28.448248 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d70dec9a-dc79-4378-b2d4-f22ef6956150 could not be found. Jul 28 04:06:28.448248 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:28.448248 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:28.448248 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:28.448248 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:28.448248 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:28.448248 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:28.448248 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:28.448248 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:28.448248 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d70dec9a-dc79-4378-b2d4-f22ef6956150 could not be found. Jul 28 04:06:28.448248 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:28.455733 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8d2a8ee3-84d9-4957-9be1-3745e585e049 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Returning 404 to user: Instance d70dec9a-dc79-4378-b2d4-f22ef6956150 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:28.457144 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8d2a8ee3-84d9-4957-9be1-3745e585e049 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150" status: 404 len: 111 microversion: 2.1 time: 0.079017 Jul 28 04:06:28.461860 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 427/796] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:28 2022] GET /compute/v2.1/servers/d70dec9a-dc79-4378-b2d4-f22ef6956150 => generated 111 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:06:29.552564 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-64877b0d-c4c7-4769-9fce-d2ce3799f62a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:29.553762 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-64877b0d-c4c7-4769-9fce-d2ce3799f62a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:29.561404 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-64877b0d-c4c7-4769-9fce-d2ce3799f62a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:29.562272 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-64877b0d-c4c7-4769-9fce-d2ce3799f62a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:29.563519 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-64877b0d-c4c7-4769-9fce-d2ce3799f62a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:29.564010 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-64877b0d-c4c7-4769-9fce-d2ce3799f62a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:29.637068 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-64877b0d-c4c7-4769-9fce-d2ce3799f62a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01/ips" status: 200 len: 151 microversion: 2.20 time: 0.088885 Jul 28 04:06:29.638351 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-351351d5-2bda-45f9-8b85-1fce6abef1f3 req-ff02188d-ed78-44b1-866a-93f697b672ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "042cba62-5323-4dd0-9ad7-92ec0f0746c5", "tag": "9433ba71-4c92-4e59-94cf-c5886d010db8"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:29.643156 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 370/797] 10.222.0.46 () {60 vars in 1289 bytes} [Thu Jul 28 04:06:29 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01/ips => generated 151 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:06:29.654966 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-bd108659-c83e-4284-b1cb-c97968949949 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:29.655448 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-351351d5-2bda-45f9-8b85-1fce6abef1f3 req-ff02188d-ed78-44b1-866a-93f697b672ab service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:29.655723 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-bd108659-c83e-4284-b1cb-c97968949949 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:29.658184 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-351351d5-2bda-45f9-8b85-1fce6abef1f3 req-ff02188d-ed78-44b1-866a-93f697b672ab service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:29.663073 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bd108659-c83e-4284-b1cb-c97968949949 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:29.663843 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bd108659-c83e-4284-b1cb-c97968949949 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:29.664764 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bd108659-c83e-4284-b1cb-c97968949949 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:29.665448 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bd108659-c83e-4284-b1cb-c97968949949 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:29.680815 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-351351d5-2bda-45f9-8b85-1fce6abef1f3 req-ff02188d-ed78-44b1-866a-93f697b672ab service nova] Creating event network-changed:9433ba71-4c92-4e59-94cf-c5886d010db8 for instance 042cba62-5323-4dd0-9ad7-92ec0f0746c5 on hv-cinder-79987 Jul 28 04:06:29.682673 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.wsgi [None req-bd108659-c83e-4284-b1cb-c97968949949 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] HTTP exception thrown: Instance 317bde19-5d15-4691-b014-3e2d001184e7 could not be found. Jul 28 04:06:29.685321 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-bd108659-c83e-4284-b1cb-c97968949949 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Request method failure captured: Jul 28 04:06:29.685321 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: request: DELETE /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7 HTTP/1.1 Jul 28 04:06:29.685321 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept: application/json Jul 28 04:06:29.685321 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept-Encoding: identity Jul 28 04:06:29.685321 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Connection: close Jul 28 04:06:29.685321 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Length: 0 Jul 28 04:06:29.685321 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Type: application/json Jul 28 04:06:29.685321 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Host: 10.222.0.46 Jul 28 04:06:29.685321 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Openstack-System-Scope: None Jul 28 04:06:29.685321 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:29.685321 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Auth-Token: gAAAAABi4gmoXQtNoyNZeVOBtHeH0p0IZl6gLmXu7uMplYaqMcIU3TXk6NAztCb7-3xvXPbqffriel8JQiqKAHgD2FYfvE1RoXCiUMTvpIZjixGVtBiBXhQr6lOIK0tmH4bMvCgHENHbbkhJpWpz1XJYt5CJBH3JqJi5ypO8pp_YsE0VFSnKOUI Jul 28 04:06:29.685321 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Id: None Jul 28 04:06:29.685321 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Name: None Jul 28 04:06:29.685321 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Identity-Status: Confirmed Jul 28 04:06:29.685321 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Is-Admin-Project: True Jul 28 04:06:29.685321 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Id: default Jul 28 04:06:29.685321 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Name: Default Jul 28 04:06:29.685321 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:06:29.685321 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:29.685321 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Role: reader,member Jul 28 04:06:29.685321 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Roles: reader,member Jul 28 04:06:29.686898 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_18a927e9f5da42d7b34752c8b2db211a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/18a927e9f5da42d7b34752c8b2db211a"}]}] Jul 28 04:06:29.686898 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:29.686898 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:06:29.686898 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:29.686898 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:06:29.686898 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Id: default Jul 28 04:06:29.686898 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Name: Default Jul 28 04:06:29.686898 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Id: c3308761e9d2495e95e127bbc7b9c5e2 Jul 28 04:06:29.686898 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Name: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:06:29.686898 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: method: > Jul 28 04:06:29.686898 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: exception: Instance 317bde19-5d15-4691-b014-3e2d001184e7 could not be found. Jul 28 04:06:29.686898 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: action_args: {'id': '317bde19-5d15-4691-b014-3e2d001184e7'} Jul 28 04:06:29.687822 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:29.687822 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:29.687822 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:06:29.687822 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:06:29.687822 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:06:29.687822 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:06:29.687822 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:06:29.687822 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:06:29.687822 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:06:29.687822 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:06:29.687822 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317bde19-5d15-4691-b014-3e2d001184e7 could not be found. Jul 28 04:06:29.687822 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:29.687822 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:29.687822 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:29.687822 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:29.687822 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:29.687822 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:29.687822 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:29.687822 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:29.687822 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:29.689656 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:29.689656 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:06:29.689656 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:06:29.689656 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:06:29.689656 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:06:29.689656 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:06:29.689656 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:06:29.689656 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:06:29.689656 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:06:29.689656 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317bde19-5d15-4691-b014-3e2d001184e7 could not be found. Jul 28 04:06:29.689656 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:29.689656 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:29.689656 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:29.689656 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:29.689656 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:29.689656 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:29.689656 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:29.689656 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:29.689656 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317bde19-5d15-4691-b014-3e2d001184e7 could not be found. Jul 28 04:06:29.689656 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:29.691020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-351351d5-2bda-45f9-8b85-1fce6abef1f3 req-ff02188d-ed78-44b1-866a-93f697b672ab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053614 Jul 28 04:06:29.691020 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 428/798] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:06:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:06:29.691988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-bd108659-c83e-4284-b1cb-c97968949949 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Returning 404 to user: Instance 317bde19-5d15-4691-b014-3e2d001184e7 could not be found. {{(pid=118186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:29.693028 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-bd108659-c83e-4284-b1cb-c97968949949 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "DELETE /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7" status: 404 len: 111 microversion: 2.1 time: 0.043060 Jul 28 04:06:29.693805 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 371/799] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:06:29 2022] DELETE /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:06:29.704072 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-613bef25-00d9-469a-8bc1-28b342816086 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:29.704927 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-613bef25-00d9-469a-8bc1-28b342816086 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: 317bde19-5d15-4691-b014-3e2d001184e7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:29.712773 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-613bef25-00d9-469a-8bc1-28b342816086 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:29.713361 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-613bef25-00d9-469a-8bc1-28b342816086 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:29.714323 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-613bef25-00d9-469a-8bc1-28b342816086 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:29.723270 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-613bef25-00d9-469a-8bc1-28b342816086 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:29.732718 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-613bef25-00d9-469a-8bc1-28b342816086 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] HTTP exception thrown: Instance 317bde19-5d15-4691-b014-3e2d001184e7 could not be found. Jul 28 04:06:29.736055 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-613bef25-00d9-469a-8bc1-28b342816086 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Request method failure captured: Jul 28 04:06:29.736055 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7 HTTP/1.1 Jul 28 04:06:29.736055 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:06:29.736055 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:06:29.736055 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:06:29.736055 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:06:29.736055 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:06:29.736055 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:06:29.736055 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:06:29.736055 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:29.736055 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gmoXQtNoyNZeVOBtHeH0p0IZl6gLmXu7uMplYaqMcIU3TXk6NAztCb7-3xvXPbqffriel8JQiqKAHgD2FYfvE1RoXCiUMTvpIZjixGVtBiBXhQr6lOIK0tmH4bMvCgHENHbbkhJpWpz1XJYt5CJBH3JqJi5ypO8pp_YsE0VFSnKOUI Jul 28 04:06:29.736055 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:06:29.736055 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:06:29.736055 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:06:29.736055 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:06:29.736055 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:06:29.736055 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:06:29.736055 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:06:29.736055 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:29.736055 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:06:29.736055 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:06:29.737366 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_18a927e9f5da42d7b34752c8b2db211a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/18a927e9f5da42d7b34752c8b2db211a"}]}] Jul 28 04:06:29.737366 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:29.737366 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:06:29.737366 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:29.737366 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:06:29.737366 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:06:29.737366 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:06:29.737366 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: c3308761e9d2495e95e127bbc7b9c5e2 Jul 28 04:06:29.737366 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:06:29.737366 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:06:29.737366 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Instance 317bde19-5d15-4691-b014-3e2d001184e7 could not be found. Jul 28 04:06:29.737366 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': '317bde19-5d15-4691-b014-3e2d001184e7'} Jul 28 04:06:29.738083 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:29.738083 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:29.738083 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:06:29.738083 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:06:29.738083 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:06:29.738083 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:06:29.738083 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:06:29.738083 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:06:29.738083 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:06:29.738083 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:06:29.738083 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 317bde19-5d15-4691-b014-3e2d001184e7 could not be found. Jul 28 04:06:29.738083 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:29.738083 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:29.738083 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:29.738083 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:29.738083 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:29.738083 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:29.738083 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:29.738083 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:29.738083 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:29.739287 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:29.739287 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:06:29.739287 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:06:29.739287 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:06:29.739287 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:06:29.739287 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:06:29.739287 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:06:29.739287 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 317bde19-5d15-4691-b014-3e2d001184e7 could not be found. Jul 28 04:06:29.739287 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:29.739287 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:29.739287 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:29.739287 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:29.739287 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:29.739287 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:29.739287 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:29.739287 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:29.739287 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 317bde19-5d15-4691-b014-3e2d001184e7 could not be found. Jul 28 04:06:29.739287 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:29.740379 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-613bef25-00d9-469a-8bc1-28b342816086 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Returning 404 to user: Instance 317bde19-5d15-4691-b014-3e2d001184e7 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:29.740379 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-613bef25-00d9-469a-8bc1-28b342816086 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7" status: 404 len: 111 microversion: 2.1 time: 0.038991 Jul 28 04:06:29.749081 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c3a36ef9-c57c-4f4d-9455-d643290cd5c3 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:29.749586 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c3a36ef9-c57c-4f4d-9455-d643290cd5c3 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:29.755861 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 429/800] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:29 2022] GET /compute/v2.1/servers/317bde19-5d15-4691-b014-3e2d001184e7 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:06:29.758508 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c3a36ef9-c57c-4f4d-9455-d643290cd5c3 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:29.759184 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c3a36ef9-c57c-4f4d-9455-d643290cd5c3 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:29.760232 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c3a36ef9-c57c-4f4d-9455-d643290cd5c3 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:29.761068 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c3a36ef9-c57c-4f4d-9455-d643290cd5c3 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:29.783953 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.wsgi [None req-c3a36ef9-c57c-4f4d-9455-d643290cd5c3 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] HTTP exception thrown: Instance fa036966-7c31-4a36-97fd-4d3eadd09fb0 could not be found. Jul 28 04:06:29.787114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c3a36ef9-c57c-4f4d-9455-d643290cd5c3 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Request method failure captured: Jul 28 04:06:29.787114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: request: DELETE /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 HTTP/1.1 Jul 28 04:06:29.787114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept: application/json Jul 28 04:06:29.787114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept-Encoding: identity Jul 28 04:06:29.787114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Connection: close Jul 28 04:06:29.787114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Length: 0 Jul 28 04:06:29.787114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Type: application/json Jul 28 04:06:29.787114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Host: 10.222.0.46 Jul 28 04:06:29.787114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Openstack-System-Scope: None Jul 28 04:06:29.787114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:29.787114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Auth-Token: gAAAAABi4gmoXQtNoyNZeVOBtHeH0p0IZl6gLmXu7uMplYaqMcIU3TXk6NAztCb7-3xvXPbqffriel8JQiqKAHgD2FYfvE1RoXCiUMTvpIZjixGVtBiBXhQr6lOIK0tmH4bMvCgHENHbbkhJpWpz1XJYt5CJBH3JqJi5ypO8pp_YsE0VFSnKOUI Jul 28 04:06:29.787114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Id: None Jul 28 04:06:29.787114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Name: None Jul 28 04:06:29.787114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Identity-Status: Confirmed Jul 28 04:06:29.787114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Is-Admin-Project: True Jul 28 04:06:29.787114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Id: default Jul 28 04:06:29.787114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Name: Default Jul 28 04:06:29.787114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:06:29.787114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:29.787114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Role: reader,member Jul 28 04:06:29.787114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Roles: reader,member Jul 28 04:06:29.788648 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_18a927e9f5da42d7b34752c8b2db211a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/18a927e9f5da42d7b34752c8b2db211a"}]}] Jul 28 04:06:29.788648 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:29.788648 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:06:29.788648 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:29.788648 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:06:29.788648 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Id: default Jul 28 04:06:29.788648 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Name: Default Jul 28 04:06:29.788648 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Id: c3308761e9d2495e95e127bbc7b9c5e2 Jul 28 04:06:29.788648 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Name: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:06:29.788648 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: method: > Jul 28 04:06:29.788648 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: exception: Instance fa036966-7c31-4a36-97fd-4d3eadd09fb0 could not be found. Jul 28 04:06:29.788648 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: action_args: {'id': 'fa036966-7c31-4a36-97fd-4d3eadd09fb0'} Jul 28 04:06:29.789551 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:29.789551 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:29.789551 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:06:29.789551 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:06:29.789551 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:06:29.789551 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:06:29.789551 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:06:29.789551 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:06:29.789551 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:06:29.789551 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:06:29.789551 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa036966-7c31-4a36-97fd-4d3eadd09fb0 could not be found. Jul 28 04:06:29.789551 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:29.789551 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:29.789551 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:29.789551 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:29.789551 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:29.789551 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:29.789551 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:29.789551 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:29.789551 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:29.790896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:29.790896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:06:29.790896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:06:29.790896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:06:29.790896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:06:29.790896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:06:29.790896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:06:29.790896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:06:29.790896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:06:29.790896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa036966-7c31-4a36-97fd-4d3eadd09fb0 could not be found. Jul 28 04:06:29.790896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:29.790896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:29.790896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:29.790896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:29.790896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:29.790896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:29.790896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:29.790896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:29.790896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa036966-7c31-4a36-97fd-4d3eadd09fb0 could not be found. Jul 28 04:06:29.790896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:29.793467 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c3a36ef9-c57c-4f4d-9455-d643290cd5c3 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Returning 404 to user: Instance fa036966-7c31-4a36-97fd-4d3eadd09fb0 could not be found. {{(pid=118186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:29.794773 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-c3a36ef9-c57c-4f4d-9455-d643290cd5c3 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "DELETE /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 404 len: 111 microversion: 2.1 time: 0.052230 Jul 28 04:06:29.798984 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 372/801] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:06:29 2022] DELETE /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:06:29.808000 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fc0c48d5-e4c9-4d95-a33d-f46e272eebdf tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:29.808696 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-fc0c48d5-e4c9-4d95-a33d-f46e272eebdf tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: fa036966-7c31-4a36-97fd-4d3eadd09fb0] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:29.819835 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fc0c48d5-e4c9-4d95-a33d-f46e272eebdf tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:29.820340 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fc0c48d5-e4c9-4d95-a33d-f46e272eebdf tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:29.821311 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fc0c48d5-e4c9-4d95-a33d-f46e272eebdf tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:29.822482 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fc0c48d5-e4c9-4d95-a33d-f46e272eebdf tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:29.841610 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-fc0c48d5-e4c9-4d95-a33d-f46e272eebdf tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] HTTP exception thrown: Instance fa036966-7c31-4a36-97fd-4d3eadd09fb0 could not be found. Jul 28 04:06:29.844760 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fc0c48d5-e4c9-4d95-a33d-f46e272eebdf tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Request method failure captured: Jul 28 04:06:29.844760 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 HTTP/1.1 Jul 28 04:06:29.844760 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:06:29.844760 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:06:29.844760 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:06:29.844760 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:06:29.844760 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:06:29.844760 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:06:29.844760 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:06:29.844760 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:29.844760 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gmoXQtNoyNZeVOBtHeH0p0IZl6gLmXu7uMplYaqMcIU3TXk6NAztCb7-3xvXPbqffriel8JQiqKAHgD2FYfvE1RoXCiUMTvpIZjixGVtBiBXhQr6lOIK0tmH4bMvCgHENHbbkhJpWpz1XJYt5CJBH3JqJi5ypO8pp_YsE0VFSnKOUI Jul 28 04:06:29.844760 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:06:29.844760 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:06:29.844760 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:06:29.844760 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:06:29.844760 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:06:29.844760 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:06:29.844760 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:06:29.844760 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:29.844760 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:06:29.844760 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:06:29.846298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_18a927e9f5da42d7b34752c8b2db211a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/18a927e9f5da42d7b34752c8b2db211a"}]}] Jul 28 04:06:29.846298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:29.846298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:06:29.846298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:29.846298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:06:29.846298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:06:29.846298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:06:29.846298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: c3308761e9d2495e95e127bbc7b9c5e2 Jul 28 04:06:29.846298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:06:29.846298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:06:29.846298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Instance fa036966-7c31-4a36-97fd-4d3eadd09fb0 could not be found. Jul 28 04:06:29.846298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': 'fa036966-7c31-4a36-97fd-4d3eadd09fb0'} Jul 28 04:06:29.847088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:29.847088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:29.847088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:06:29.847088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:06:29.847088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:06:29.847088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:06:29.847088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:06:29.847088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:06:29.847088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:06:29.847088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:06:29.847088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fa036966-7c31-4a36-97fd-4d3eadd09fb0 could not be found. Jul 28 04:06:29.847088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:29.847088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:29.847088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:29.847088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:29.847088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:29.847088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:29.847088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:29.847088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:29.847088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:29.848275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:29.848275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:06:29.848275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:06:29.848275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:06:29.848275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:06:29.848275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:06:29.848275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:06:29.848275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fa036966-7c31-4a36-97fd-4d3eadd09fb0 could not be found. Jul 28 04:06:29.848275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:29.848275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:29.848275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:29.848275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:29.848275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:29.848275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:29.848275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:29.848275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:29.848275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fa036966-7c31-4a36-97fd-4d3eadd09fb0 could not be found. Jul 28 04:06:29.848275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:29.849337 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fc0c48d5-e4c9-4d95-a33d-f46e272eebdf tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Returning 404 to user: Instance fa036966-7c31-4a36-97fd-4d3eadd09fb0 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:29.849337 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-fc0c48d5-e4c9-4d95-a33d-f46e272eebdf tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0" status: 404 len: 111 microversion: 2.1 time: 0.044399 Jul 28 04:06:29.850320 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 430/802] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:29 2022] GET /compute/v2.1/servers/fa036966-7c31-4a36-97fd-4d3eadd09fb0 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:06:30.147351 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c385926b-f05c-4843-8799-1010654ed7aa tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:30.148150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c385926b-f05c-4843-8799-1010654ed7aa tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:30.160061 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c385926b-f05c-4843-8799-1010654ed7aa tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:30.160541 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c385926b-f05c-4843-8799-1010654ed7aa tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:30.162832 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c385926b-f05c-4843-8799-1010654ed7aa tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:30.163276 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c385926b-f05c-4843-8799-1010654ed7aa tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:30.195216 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.wsgi [None req-c385926b-f05c-4843-8799-1010654ed7aa tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] HTTP exception thrown: Instance f9103b14-a0f8-40f5-b38b-54b90cae2131 could not be found. Jul 28 04:06:30.197359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c385926b-f05c-4843-8799-1010654ed7aa tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Request method failure captured: Jul 28 04:06:30.197359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: request: DELETE /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 HTTP/1.1 Jul 28 04:06:30.197359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept: application/json Jul 28 04:06:30.197359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept-Encoding: identity Jul 28 04:06:30.197359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Connection: close Jul 28 04:06:30.197359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Length: 0 Jul 28 04:06:30.197359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Type: application/json Jul 28 04:06:30.197359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Host: 10.222.0.46 Jul 28 04:06:30.197359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Openstack-System-Scope: None Jul 28 04:06:30.197359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:30.197359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Auth-Token: gAAAAABi4gmoXQtNoyNZeVOBtHeH0p0IZl6gLmXu7uMplYaqMcIU3TXk6NAztCb7-3xvXPbqffriel8JQiqKAHgD2FYfvE1RoXCiUMTvpIZjixGVtBiBXhQr6lOIK0tmH4bMvCgHENHbbkhJpWpz1XJYt5CJBH3JqJi5ypO8pp_YsE0VFSnKOUI Jul 28 04:06:30.197359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Id: None Jul 28 04:06:30.197359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Name: None Jul 28 04:06:30.197359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Identity-Status: Confirmed Jul 28 04:06:30.197359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Is-Admin-Project: True Jul 28 04:06:30.197359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Id: default Jul 28 04:06:30.197359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Name: Default Jul 28 04:06:30.197359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:06:30.197359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:30.197359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Role: reader,member Jul 28 04:06:30.197359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Roles: reader,member Jul 28 04:06:30.199351 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_18a927e9f5da42d7b34752c8b2db211a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/18a927e9f5da42d7b34752c8b2db211a"}]}] Jul 28 04:06:30.199351 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:30.199351 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:06:30.199351 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:30.199351 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:06:30.199351 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Id: default Jul 28 04:06:30.199351 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Name: Default Jul 28 04:06:30.199351 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Id: c3308761e9d2495e95e127bbc7b9c5e2 Jul 28 04:06:30.199351 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Name: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:06:30.199351 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: method: > Jul 28 04:06:30.199351 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: exception: Instance f9103b14-a0f8-40f5-b38b-54b90cae2131 could not be found. Jul 28 04:06:30.199351 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: action_args: {'id': 'f9103b14-a0f8-40f5-b38b-54b90cae2131'} Jul 28 04:06:30.200248 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:30.200248 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:30.200248 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:06:30.200248 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:06:30.200248 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:06:30.200248 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:06:30.200248 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:06:30.200248 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:06:30.200248 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:06:30.200248 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:06:30.200248 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9103b14-a0f8-40f5-b38b-54b90cae2131 could not be found. Jul 28 04:06:30.200248 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:30.200248 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:30.200248 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:30.200248 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:30.200248 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:30.200248 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:30.200248 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:30.200248 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:30.200248 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:30.201685 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:30.201685 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:06:30.201685 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:06:30.201685 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:06:30.201685 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:06:30.201685 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:06:30.201685 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:06:30.201685 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:06:30.201685 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:06:30.201685 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9103b14-a0f8-40f5-b38b-54b90cae2131 could not be found. Jul 28 04:06:30.201685 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:30.201685 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:30.201685 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:30.201685 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:30.201685 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:30.201685 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:30.201685 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:30.201685 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:30.201685 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9103b14-a0f8-40f5-b38b-54b90cae2131 could not be found. Jul 28 04:06:30.201685 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:06:30.204516 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c385926b-f05c-4843-8799-1010654ed7aa tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Returning 404 to user: Instance f9103b14-a0f8-40f5-b38b-54b90cae2131 could not be found. {{(pid=118186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:30.205581 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-c385926b-f05c-4843-8799-1010654ed7aa tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "DELETE /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 404 len: 111 microversion: 2.1 time: 0.062632 Jul 28 04:06:30.206306 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 373/803] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:06:30 2022] DELETE /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:06:30.215134 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-12d6bb71-bdd4-4ebb-afdc-228c576dd852 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:30.215861 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-12d6bb71-bdd4-4ebb-afdc-228c576dd852 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] [instance: f9103b14-a0f8-40f5-b38b-54b90cae2131] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:30.224174 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-12d6bb71-bdd4-4ebb-afdc-228c576dd852 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:30.224646 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-12d6bb71-bdd4-4ebb-afdc-228c576dd852 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:30.225431 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-12d6bb71-bdd4-4ebb-afdc-228c576dd852 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:30.225974 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-12d6bb71-bdd4-4ebb-afdc-228c576dd852 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:30.244899 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-12d6bb71-bdd4-4ebb-afdc-228c576dd852 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] HTTP exception thrown: Instance f9103b14-a0f8-40f5-b38b-54b90cae2131 could not be found. Jul 28 04:06:30.247418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-12d6bb71-bdd4-4ebb-afdc-228c576dd852 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Request method failure captured: Jul 28 04:06:30.247418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 HTTP/1.1 Jul 28 04:06:30.247418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:06:30.247418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:06:30.247418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:06:30.247418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:06:30.247418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:06:30.247418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:06:30.247418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:06:30.247418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:06:30.247418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gmoXQtNoyNZeVOBtHeH0p0IZl6gLmXu7uMplYaqMcIU3TXk6NAztCb7-3xvXPbqffriel8JQiqKAHgD2FYfvE1RoXCiUMTvpIZjixGVtBiBXhQr6lOIK0tmH4bMvCgHENHbbkhJpWpz1XJYt5CJBH3JqJi5ypO8pp_YsE0VFSnKOUI Jul 28 04:06:30.247418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:06:30.247418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:06:30.247418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:06:30.247418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:06:30.247418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:06:30.247418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:06:30.247418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:06:30.247418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:30.247418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:06:30.247418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:06:30.248997 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_18a927e9f5da42d7b34752c8b2db211a", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/18a927e9f5da42d7b34752c8b2db211a"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/18a927e9f5da42d7b34752c8b2db211a"}]}] Jul 28 04:06:30.248997 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:30.248997 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 18a927e9f5da42d7b34752c8b2db211a Jul 28 04:06:30.248997 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1590720999 Jul 28 04:06:30.248997 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:06:30.248997 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:06:30.248997 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:06:30.248997 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: c3308761e9d2495e95e127bbc7b9c5e2 Jul 28 04:06:30.248997 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeNegativeTest-1590720999-project Jul 28 04:06:30.248997 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:06:30.248997 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Instance f9103b14-a0f8-40f5-b38b-54b90cae2131 could not be found. Jul 28 04:06:30.248997 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': 'f9103b14-a0f8-40f5-b38b-54b90cae2131'} Jul 28 04:06:30.250426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:06:30.250426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:30.250426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:06:30.250426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:06:30.250426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:06:30.250426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:06:30.250426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:06:30.250426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:06:30.250426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:06:30.250426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:06:30.250426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f9103b14-a0f8-40f5-b38b-54b90cae2131 could not be found. Jul 28 04:06:30.250426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:30.250426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:30.250426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:30.250426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:30.250426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:30.250426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:30.250426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:06:30.250426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:06:30.250426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:06:30.252776 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:06:30.252776 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:06:30.252776 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:06:30.252776 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:06:30.252776 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:06:30.252776 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:06:30.252776 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:06:30.252776 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f9103b14-a0f8-40f5-b38b-54b90cae2131 could not be found. Jul 28 04:06:30.252776 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:30.252776 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:06:30.252776 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:30.252776 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:06:30.252776 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:06:30.252776 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:06:30.252776 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:06:30.252776 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:06:30.252776 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f9103b14-a0f8-40f5-b38b-54b90cae2131 could not be found. Jul 28 04:06:30.252776 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:06:30.255447 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-12d6bb71-bdd4-4ebb-afdc-228c576dd852 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] Returning 404 to user: Instance f9103b14-a0f8-40f5-b38b-54b90cae2131 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:06:30.256523 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-12d6bb71-bdd4-4ebb-afdc-228c576dd852 tempest-AttachVolumeNegativeTest-1590720999 tempest-AttachVolumeNegativeTest-1590720999-project] 10.222.0.46 "GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131" status: 404 len: 111 microversion: 2.1 time: 0.045264 Jul 28 04:06:30.257894 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 431/804] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:06:30 2022] GET /compute/v2.1/servers/f9103b14-a0f8-40f5-b38b-54b90cae2131 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 28 04:06:32.549549 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-ebc9eb68-12cf-4743-83ed-bc0282592551 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:32.550297 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-ebc9eb68-12cf-4743-83ed-bc0282592551 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:32.563835 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ebc9eb68-12cf-4743-83ed-bc0282592551 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:32.564309 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ebc9eb68-12cf-4743-83ed-bc0282592551 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:32.566364 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ebc9eb68-12cf-4743-83ed-bc0282592551 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:32.566846 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ebc9eb68-12cf-4743-83ed-bc0282592551 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:32.615410 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.objects.instance [None req-ebc9eb68-12cf-4743-83ed-bc0282592551 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lazy-loading 'flavor' on Instance uuid 489708ab-f8bf-4f93-aa7a-907559b15d01 {{(pid=118186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:06:32.848908 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-ebc9eb68-12cf-4743-83ed-bc0282592551 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "POST /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01/action" status: 202 len: 0 microversion: 2.20 time: 0.311525 Jul 28 04:06:32.849701 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 374/805] 10.222.0.46 () {62 vars in 1319 bytes} [Thu Jul 28 04:06:32 2022] POST /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01/action => generated 0 bytes in 313 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:06:32.858566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c6b04b76-09db-4111-8523-a9f1e63b63b2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:32.860519 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c6b04b76-09db-4111-8523-a9f1e63b63b2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:32.868579 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c6b04b76-09db-4111-8523-a9f1e63b63b2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:32.868972 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c6b04b76-09db-4111-8523-a9f1e63b63b2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:32.870305 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c6b04b76-09db-4111-8523-a9f1e63b63b2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:32.870894 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c6b04b76-09db-4111-8523-a9f1e63b63b2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:33.060981 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c6b04b76-09db-4111-8523-a9f1e63b63b2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:33.072071 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c6b04b76-09db-4111-8523-a9f1e63b63b2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:33.073662 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c6b04b76-09db-4111-8523-a9f1e63b63b2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:33.074900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c6b04b76-09db-4111-8523-a9f1e63b63b2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1724 microversion: 2.20 time: 0.220326 Jul 28 04:06:33.075755 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 432/806] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:32 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1724 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:06:34.106365 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-f732a7f8-648e-4398-bc66-48cb098b3a45 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:34.107642 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-f732a7f8-648e-4398-bc66-48cb098b3a45 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:34.129288 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f732a7f8-648e-4398-bc66-48cb098b3a45 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:34.129886 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f732a7f8-648e-4398-bc66-48cb098b3a45 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:34.130665 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f732a7f8-648e-4398-bc66-48cb098b3a45 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:34.131168 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f732a7f8-648e-4398-bc66-48cb098b3a45 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:34.292273 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-f732a7f8-648e-4398-bc66-48cb098b3a45 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:34.305272 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-f732a7f8-648e-4398-bc66-48cb098b3a45 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:34.307100 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-f732a7f8-648e-4398-bc66-48cb098b3a45 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:34.308389 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-f732a7f8-648e-4398-bc66-48cb098b3a45 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1724 microversion: 2.20 time: 0.211809 Jul 28 04:06:34.309300 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 375/807] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:34 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1724 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:06:35.333981 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e12c69d6-cd25-4694-a01e-6b4ce606c568 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:35.334612 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e12c69d6-cd25-4694-a01e-6b4ce606c568 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:35.341980 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e12c69d6-cd25-4694-a01e-6b4ce606c568 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:35.342705 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e12c69d6-cd25-4694-a01e-6b4ce606c568 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:35.344154 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e12c69d6-cd25-4694-a01e-6b4ce606c568 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:35.344693 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e12c69d6-cd25-4694-a01e-6b4ce606c568 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:35.501116 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e12c69d6-cd25-4694-a01e-6b4ce606c568 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:35.510426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e12c69d6-cd25-4694-a01e-6b4ce606c568 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:35.512401 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e12c69d6-cd25-4694-a01e-6b4ce606c568 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:35.513570 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e12c69d6-cd25-4694-a01e-6b4ce606c568 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1724 microversion: 2.20 time: 0.184333 Jul 28 04:06:35.514310 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 433/808] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:35 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:06:36.537527 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-879f7e13-b3a2-40ac-9464-665387060789 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:36.538146 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-879f7e13-b3a2-40ac-9464-665387060789 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:36.544947 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-879f7e13-b3a2-40ac-9464-665387060789 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:36.545398 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-879f7e13-b3a2-40ac-9464-665387060789 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:36.546162 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-879f7e13-b3a2-40ac-9464-665387060789 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:36.547904 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-879f7e13-b3a2-40ac-9464-665387060789 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:36.686246 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-879f7e13-b3a2-40ac-9464-665387060789 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:36.694506 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-879f7e13-b3a2-40ac-9464-665387060789 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:36.696053 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-879f7e13-b3a2-40ac-9464-665387060789 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:36.697223 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-879f7e13-b3a2-40ac-9464-665387060789 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1724 microversion: 2.20 time: 0.163880 Jul 28 04:06:36.697901 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 376/809] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:36 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:06:36.717367 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-506da1b8-7e9a-42ef-8de7-0b44382a52e2 tempest-VolumesTestJSON-409017438 tempest-VolumesTestJSON-409017438-project] Calling method '.version_select at 0x7fa6ee004550>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:36.767093 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-506da1b8-7e9a-42ef-8de7-0b44382a52e2 tempest-VolumesTestJSON-409017438 tempest-VolumesTestJSON-409017438-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/d4f27148-ead4-44d1-a58f-37d594fa3d15" status: 200 len: 351 microversion: 2.1 time: 0.053412 Jul 28 04:06:36.767816 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 434/810] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 04:06:36 2022] GET /compute/v2.1/os-volumes/d4f27148-ead4-44d1-a58f-37d594fa3d15 => generated 351 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:37.721251 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-0b2d0c09-4dfe-4993-8412-4b3a991e5f40 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:37.721902 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-0b2d0c09-4dfe-4993-8412-4b3a991e5f40 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:37.728486 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0b2d0c09-4dfe-4993-8412-4b3a991e5f40 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:37.728942 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0b2d0c09-4dfe-4993-8412-4b3a991e5f40 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:37.729715 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0b2d0c09-4dfe-4993-8412-4b3a991e5f40 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:37.730157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0b2d0c09-4dfe-4993-8412-4b3a991e5f40 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:37.745258 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:37.908395 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-0b2d0c09-4dfe-4993-8412-4b3a991e5f40 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:37.917168 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-0b2d0c09-4dfe-4993-8412-4b3a991e5f40 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:37.918691 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-0b2d0c09-4dfe-4993-8412-4b3a991e5f40 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:37.919926 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-0b2d0c09-4dfe-4993-8412-4b3a991e5f40 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1724 microversion: 2.20 time: 0.203204 Jul 28 04:06:37.920494 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 377/811] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:37 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1724 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:06:38.113365 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8e79ee38-fb06-43e6-a143-0d10230031a5 tempest-VolumesTestJSON-409017438 tempest-VolumesTestJSON-409017438-project] Calling method '.version_select at 0x7fa6f29a0c10>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:38.163904 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8e79ee38-fb06-43e6-a143-0d10230031a5 tempest-VolumesTestJSON-409017438 tempest-VolumesTestJSON-409017438-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/6f4527a6-6ccc-40e3-bcab-59d4c8db22bb" status: 200 len: 351 microversion: 2.1 time: 0.055889 Jul 28 04:06:38.164681 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 435/812] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 04:06:38 2022] GET /compute/v2.1/os-volumes/6f4527a6-6ccc-40e3-bcab-59d4c8db22bb => generated 351 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:38.944018 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-fdaff83f-f818-4d4a-9fe6-cc29852dcc67 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:38.944772 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-fdaff83f-f818-4d4a-9fe6-cc29852dcc67 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:38.951290 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fdaff83f-f818-4d4a-9fe6-cc29852dcc67 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:38.951742 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fdaff83f-f818-4d4a-9fe6-cc29852dcc67 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:38.952505 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fdaff83f-f818-4d4a-9fe6-cc29852dcc67 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:38.953186 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fdaff83f-f818-4d4a-9fe6-cc29852dcc67 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:39.085023 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-fdaff83f-f818-4d4a-9fe6-cc29852dcc67 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:39.092932 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-fdaff83f-f818-4d4a-9fe6-cc29852dcc67 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:39.095211 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-fdaff83f-f818-4d4a-9fe6-cc29852dcc67 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:39.096397 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-fdaff83f-f818-4d4a-9fe6-cc29852dcc67 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1724 microversion: 2.20 time: 0.156388 Jul 28 04:06:39.097023 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 378/813] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:38 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:06:39.521253 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4bd1bc52-03a0-49b5-b07f-8ed45f70e5a1 tempest-VolumesTestJSON-409017438 tempest-VolumesTestJSON-409017438-project] Calling method '.version_select at 0x7fa6ee010f70>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:39.570388 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4bd1bc52-03a0-49b5-b07f-8ed45f70e5a1 tempest-VolumesTestJSON-409017438 tempest-VolumesTestJSON-409017438-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/d297c9b1-89ac-4e96-bd0e-55536e4e78a6" status: 200 len: 350 microversion: 2.1 time: 0.053055 Jul 28 04:06:39.571119 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 436/814] 10.222.0.46 () {58 vars in 1245 bytes} [Thu Jul 28 04:06:39 2022] GET /compute/v2.1/os-volumes/d297c9b1-89ac-4e96-bd0e-55536e4e78a6 => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:06:39.583949 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-383995fd-75f2-4d20-ba1a-5ed4f1385b05 tempest-VolumesTestJSON-409017438 tempest-VolumesTestJSON-409017438-project] Calling method '.version_select at 0x7fa6ee03b9d0>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:39.666543 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-383995fd-75f2-4d20-ba1a-5ed4f1385b05 tempest-VolumesTestJSON-409017438 tempest-VolumesTestJSON-409017438-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.086309 Jul 28 04:06:39.667156 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 379/815] 10.222.0.46 () {58 vars in 1134 bytes} [Thu Jul 28 04:06:39 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:39.681075 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-006dfabe-c18c-4919-96fc-237ec85325ba tempest-VolumesTestJSON-409017438 tempest-VolumesTestJSON-409017438-project] Calling method '.version_select at 0x7fa6f29a0a60>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:39.761906 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-006dfabe-c18c-4919-96fc-237ec85325ba tempest-VolumesTestJSON-409017438 tempest-VolumesTestJSON-409017438-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.084486 Jul 28 04:06:39.762471 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 437/816] 10.222.0.46 () {58 vars in 1149 bytes} [Thu Jul 28 04:06:39 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:39.776136 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-02ab7a69-1ccb-468a-bddd-29b87be0cda7 tempest-VolumesTestJSON-409017438 tempest-VolumesTestJSON-409017438-project] Calling method '.version_select at 0x7fa6ee0a0f70>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:39.856816 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-02ab7a69-1ccb-468a-bddd-29b87be0cda7 tempest-VolumesTestJSON-409017438 tempest-VolumesTestJSON-409017438-project] 10.222.0.46 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084825 Jul 28 04:06:39.857387 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 380/817] 10.222.0.46 () {58 vars in 1134 bytes} [Thu Jul 28 04:06:39 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:06:39.870515 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4d6839cc-dd09-4e3b-90f7-ff795624ea3b tempest-VolumesTestJSON-409017438 tempest-VolumesTestJSON-409017438-project] Calling method '.version_select at 0x7fa6edfb1d30>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:39.954818 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4d6839cc-dd09-4e3b-90f7-ff795624ea3b tempest-VolumesTestJSON-409017438 tempest-VolumesTestJSON-409017438-project] 10.222.0.46 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087957 Jul 28 04:06:39.955399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 438/818] 10.222.0.46 () {58 vars in 1167 bytes} [Thu Jul 28 04:06:39 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:39.969537 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-9f7cad50-a407-419f-b21f-2d19a269eac4 tempest-VolumesTestJSON-409017438 tempest-VolumesTestJSON-409017438-project] Calling method '.version_select at 0x7fa6ee0a0af0>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:40.080318 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-9f7cad50-a407-419f-b21f-2d19a269eac4 tempest-VolumesTestJSON-409017438 tempest-VolumesTestJSON-409017438-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.115602 Jul 28 04:06:40.080894 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 381/819] 10.222.0.46 () {58 vars in 1170 bytes} [Thu Jul 28 04:06:39 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:40.094208 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a9148271-2eb3-4fb1-bda0-20dc58a553b5 tempest-VolumesTestJSON-409017438 tempest-VolumesTestJSON-409017438-project] Calling method '.version_select at 0x7fa6ee24c430>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:40.120044 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-522075c5-8b06-4b74-8ece-f2531f87ca57 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:40.120736 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-522075c5-8b06-4b74-8ece-f2531f87ca57 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:40.127624 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-522075c5-8b06-4b74-8ece-f2531f87ca57 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:40.128083 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-522075c5-8b06-4b74-8ece-f2531f87ca57 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:40.128872 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-522075c5-8b06-4b74-8ece-f2531f87ca57 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:40.129317 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-522075c5-8b06-4b74-8ece-f2531f87ca57 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:40.177284 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a9148271-2eb3-4fb1-bda0-20dc58a553b5 tempest-VolumesTestJSON-409017438 tempest-VolumesTestJSON-409017438-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.086883 Jul 28 04:06:40.177967 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 439/820] 10.222.0.46 () {58 vars in 1155 bytes} [Thu Jul 28 04:06:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:06:40.190880 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a377a70d-331f-49db-9815-a75aa8946508 tempest-VolumesTestJSON-409017438 tempest-VolumesTestJSON-409017438-project] Calling method '.version_select at 0x7fa6ee24c280>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:40.266594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-522075c5-8b06-4b74-8ece-f2531f87ca57 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:40.274292 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a377a70d-331f-49db-9815-a75aa8946508 tempest-VolumesTestJSON-409017438 tempest-VolumesTestJSON-409017438-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.087562 Jul 28 04:06:40.274879 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 440/821] 10.222.0.46 () {58 vars in 1188 bytes} [Thu Jul 28 04:06:40 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:06:40.279604 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-522075c5-8b06-4b74-8ece-f2531f87ca57 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:40.282461 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-522075c5-8b06-4b74-8ece-f2531f87ca57 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:40.284530 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-522075c5-8b06-4b74-8ece-f2531f87ca57 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1724 microversion: 2.20 time: 0.168302 Jul 28 04:06:40.285094 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 382/822] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:40 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:06:40.288139 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-afa631fc-1541-419b-a4ff-2a4488dba595 tempest-VolumesTestJSON-409017438 tempest-VolumesTestJSON-409017438-project] Calling method '.version_select at 0x7fa6edfb1ee0>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:40.376755 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-afa631fc-1541-419b-a4ff-2a4488dba595 tempest-VolumesTestJSON-409017438 tempest-VolumesTestJSON-409017438-project] 10.222.0.46 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.092276 Jul 28 04:06:40.377330 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 441/823] 10.222.0.46 () {58 vars in 1155 bytes} [Thu Jul 28 04:06:40 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:06:41.312943 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-6d449b3e-45e1-4350-aa02-ae7cc6a0a8d3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:41.313567 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-6d449b3e-45e1-4350-aa02-ae7cc6a0a8d3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:41.320324 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6d449b3e-45e1-4350-aa02-ae7cc6a0a8d3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:41.320775 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6d449b3e-45e1-4350-aa02-ae7cc6a0a8d3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:41.321541 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6d449b3e-45e1-4350-aa02-ae7cc6a0a8d3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:41.322113 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6d449b3e-45e1-4350-aa02-ae7cc6a0a8d3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:41.453939 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-6d449b3e-45e1-4350-aa02-ae7cc6a0a8d3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:41.461989 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-6d449b3e-45e1-4350-aa02-ae7cc6a0a8d3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:41.463561 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-6d449b3e-45e1-4350-aa02-ae7cc6a0a8d3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:41.464736 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-6d449b3e-45e1-4350-aa02-ae7cc6a0a8d3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1724 microversion: 2.20 time: 0.156504 Jul 28 04:06:41.465365 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 383/824] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:41 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:06:42.488887 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9fdfd8e6-dfc8-4634-a450-423b7256e3c1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:42.489492 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9fdfd8e6-dfc8-4634-a450-423b7256e3c1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:42.496118 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9fdfd8e6-dfc8-4634-a450-423b7256e3c1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:42.496573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9fdfd8e6-dfc8-4634-a450-423b7256e3c1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:42.497360 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9fdfd8e6-dfc8-4634-a450-423b7256e3c1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:42.497794 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9fdfd8e6-dfc8-4634-a450-423b7256e3c1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:42.515826 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:42.637618 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9fdfd8e6-dfc8-4634-a450-423b7256e3c1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:42.646528 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9fdfd8e6-dfc8-4634-a450-423b7256e3c1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:42.648091 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9fdfd8e6-dfc8-4634-a450-423b7256e3c1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:42.649276 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9fdfd8e6-dfc8-4634-a450-423b7256e3c1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1724 microversion: 2.20 time: 0.165543 Jul 28 04:06:42.649828 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 442/825] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:42 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:06:43.674551 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c60d1452-253a-4149-999b-dc183a649f45 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:43.675186 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c60d1452-253a-4149-999b-dc183a649f45 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:43.681702 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c60d1452-253a-4149-999b-dc183a649f45 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:43.682157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c60d1452-253a-4149-999b-dc183a649f45 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:43.682972 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c60d1452-253a-4149-999b-dc183a649f45 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:43.683424 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c60d1452-253a-4149-999b-dc183a649f45 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:43.825942 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-c60d1452-253a-4149-999b-dc183a649f45 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:43.834293 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-c60d1452-253a-4149-999b-dc183a649f45 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:43.835842 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-c60d1452-253a-4149-999b-dc183a649f45 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:43.837005 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-c60d1452-253a-4149-999b-dc183a649f45 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1724 microversion: 2.20 time: 0.167057 Jul 28 04:06:43.837565 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 384/826] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:43 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:06:44.861133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-55478c8e-bba8-4040-b398-d6f69a9225cc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:44.861760 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-55478c8e-bba8-4040-b398-d6f69a9225cc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:44.868480 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55478c8e-bba8-4040-b398-d6f69a9225cc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:44.868945 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55478c8e-bba8-4040-b398-d6f69a9225cc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:44.869712 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55478c8e-bba8-4040-b398-d6f69a9225cc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:44.870154 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55478c8e-bba8-4040-b398-d6f69a9225cc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:44.997639 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-55478c8e-bba8-4040-b398-d6f69a9225cc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:45.006520 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-55478c8e-bba8-4040-b398-d6f69a9225cc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:45.008056 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-55478c8e-bba8-4040-b398-d6f69a9225cc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:45.009214 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-55478c8e-bba8-4040-b398-d6f69a9225cc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1724 microversion: 2.20 time: 0.152644 Jul 28 04:06:45.009771 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 443/827] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:44 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:06:46.032426 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-894fc0b1-09e5-48b4-8a8e-67db121e09a0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:46.033084 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-894fc0b1-09e5-48b4-8a8e-67db121e09a0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:46.039916 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-894fc0b1-09e5-48b4-8a8e-67db121e09a0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:46.040306 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-894fc0b1-09e5-48b4-8a8e-67db121e09a0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:46.041059 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-894fc0b1-09e5-48b4-8a8e-67db121e09a0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:46.041485 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-894fc0b1-09e5-48b4-8a8e-67db121e09a0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:46.170600 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-894fc0b1-09e5-48b4-8a8e-67db121e09a0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:46.178550 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-894fc0b1-09e5-48b4-8a8e-67db121e09a0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:46.180133 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-894fc0b1-09e5-48b4-8a8e-67db121e09a0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:46.181300 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-894fc0b1-09e5-48b4-8a8e-67db121e09a0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1724 microversion: 2.20 time: 0.152791 Jul 28 04:06:46.181897 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 385/828] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:46 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:06:47.203968 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5cc7813d-0161-4131-876d-c77b71e2d8c7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:47.204934 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5cc7813d-0161-4131-876d-c77b71e2d8c7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:47.211493 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5cc7813d-0161-4131-876d-c77b71e2d8c7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:47.211950 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5cc7813d-0161-4131-876d-c77b71e2d8c7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:47.212720 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5cc7813d-0161-4131-876d-c77b71e2d8c7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:47.213192 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5cc7813d-0161-4131-876d-c77b71e2d8c7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:47.342855 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5cc7813d-0161-4131-876d-c77b71e2d8c7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:47.350806 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5cc7813d-0161-4131-876d-c77b71e2d8c7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:47.352331 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5cc7813d-0161-4131-876d-c77b71e2d8c7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:47.353497 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5cc7813d-0161-4131-876d-c77b71e2d8c7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1724 microversion: 2.20 time: 0.153496 Jul 28 04:06:47.354063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 444/829] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:47 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:06:48.378489 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-0b126ec9-cee8-4fb3-b8ec-48b4a1f65bb3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:48.379144 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-0b126ec9-cee8-4fb3-b8ec-48b4a1f65bb3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:48.387408 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0b126ec9-cee8-4fb3-b8ec-48b4a1f65bb3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:48.387851 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0b126ec9-cee8-4fb3-b8ec-48b4a1f65bb3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:48.388612 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0b126ec9-cee8-4fb3-b8ec-48b4a1f65bb3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:48.389044 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0b126ec9-cee8-4fb3-b8ec-48b4a1f65bb3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:48.523905 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-0b126ec9-cee8-4fb3-b8ec-48b4a1f65bb3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:48.531765 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-0b126ec9-cee8-4fb3-b8ec-48b4a1f65bb3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:48.534139 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-0b126ec9-cee8-4fb3-b8ec-48b4a1f65bb3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:48.535341 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-0b126ec9-cee8-4fb3-b8ec-48b4a1f65bb3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1724 microversion: 2.20 time: 0.160921 Jul 28 04:06:48.535912 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 386/830] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:48 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:06:49.559184 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-81edd250-4cf1-432b-9d2d-108fc34e2189 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:49.559805 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-81edd250-4cf1-432b-9d2d-108fc34e2189 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:49.562099 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=42 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:49.567742 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-81edd250-4cf1-432b-9d2d-108fc34e2189 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:49.568200 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-81edd250-4cf1-432b-9d2d-108fc34e2189 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:49.568989 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-81edd250-4cf1-432b-9d2d-108fc34e2189 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:49.569427 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-81edd250-4cf1-432b-9d2d-108fc34e2189 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:49.738201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-81edd250-4cf1-432b-9d2d-108fc34e2189 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:49.746461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-81edd250-4cf1-432b-9d2d-108fc34e2189 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:49.748044 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-81edd250-4cf1-432b-9d2d-108fc34e2189 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:49.749204 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-81edd250-4cf1-432b-9d2d-108fc34e2189 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1745 microversion: 2.20 time: 0.193977 Jul 28 04:06:49.749928 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 445/831] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:49 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1745 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:06:50.772758 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-7c0e9555-2a76-40ed-a1ab-a2c87bd47088 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:50.773376 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-7c0e9555-2a76-40ed-a1ab-a2c87bd47088 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:50.775721 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:06:50.780970 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7c0e9555-2a76-40ed-a1ab-a2c87bd47088 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:50.781419 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7c0e9555-2a76-40ed-a1ab-a2c87bd47088 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:50.782192 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7c0e9555-2a76-40ed-a1ab-a2c87bd47088 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:50.783266 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7c0e9555-2a76-40ed-a1ab-a2c87bd47088 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:50.916674 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-7c0e9555-2a76-40ed-a1ab-a2c87bd47088 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:50.925272 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-7c0e9555-2a76-40ed-a1ab-a2c87bd47088 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:50.926812 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-7c0e9555-2a76-40ed-a1ab-a2c87bd47088 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:50.928121 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-7c0e9555-2a76-40ed-a1ab-a2c87bd47088 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1745 microversion: 2.20 time: 0.159024 Jul 28 04:06:50.942895 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 387/832] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:50 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:06:51.950507 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-1541546d-5cf6-4e04-b350-1abaef0dd0ac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:51.951145 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-1541546d-5cf6-4e04-b350-1abaef0dd0ac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:51.957385 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1541546d-5cf6-4e04-b350-1abaef0dd0ac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:51.957831 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1541546d-5cf6-4e04-b350-1abaef0dd0ac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:51.958583 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1541546d-5cf6-4e04-b350-1abaef0dd0ac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:51.959042 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1541546d-5cf6-4e04-b350-1abaef0dd0ac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:52.092298 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1541546d-5cf6-4e04-b350-1abaef0dd0ac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:52.100920 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1541546d-5cf6-4e04-b350-1abaef0dd0ac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:52.102409 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1541546d-5cf6-4e04-b350-1abaef0dd0ac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:52.103590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-1541546d-5cf6-4e04-b350-1abaef0dd0ac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1745 microversion: 2.20 time: 0.157175 Jul 28 04:06:52.104162 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 446/833] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:51 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:06:53.129396 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-210eb070-5042-4c69-a9a8-7d05f604e22b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:53.130116 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-210eb070-5042-4c69-a9a8-7d05f604e22b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:53.136698 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-210eb070-5042-4c69-a9a8-7d05f604e22b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:53.137148 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-210eb070-5042-4c69-a9a8-7d05f604e22b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:53.137919 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-210eb070-5042-4c69-a9a8-7d05f604e22b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:53.138361 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-210eb070-5042-4c69-a9a8-7d05f604e22b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:53.289563 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-210eb070-5042-4c69-a9a8-7d05f604e22b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:53.299008 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-210eb070-5042-4c69-a9a8-7d05f604e22b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:53.300636 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-210eb070-5042-4c69-a9a8-7d05f604e22b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:53.301823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-210eb070-5042-4c69-a9a8-7d05f604e22b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1745 microversion: 2.20 time: 0.177233 Jul 28 04:06:53.302848 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 388/834] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:53 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:06:54.173835 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-8db04ee6-b234-4061-9e5f-dd5cf71c27ac req-3757771d-2380-4e6c-9937-5c50dd03d327 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "489708ab-f8bf-4f93-aa7a-907559b15d01", "name": "network-vif-plugged", "status": "completed", "tag": "0e9bfde3-9675-4314-9b59-4d7ba4f8ddf3"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:06:54.198685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-8db04ee6-b234-4061-9e5f-dd5cf71c27ac req-3757771d-2380-4e6c-9937-5c50dd03d327 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:54.199241 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-8db04ee6-b234-4061-9e5f-dd5cf71c27ac req-3757771d-2380-4e6c-9937-5c50dd03d327 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:54.213416 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-8db04ee6-b234-4061-9e5f-dd5cf71c27ac req-3757771d-2380-4e6c-9937-5c50dd03d327 service nova] Creating event network-vif-plugged:0e9bfde3-9675-4314-9b59-4d7ba4f8ddf3 for instance 489708ab-f8bf-4f93-aa7a-907559b15d01 on hv-cinder-79987 Jul 28 04:06:54.219568 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-8db04ee6-b234-4061-9e5f-dd5cf71c27ac req-3757771d-2380-4e6c-9937-5c50dd03d327 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049441 Jul 28 04:06:54.221499 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 447/835] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:06:54.326177 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c0d9b6ed-c83d-4cb3-9342-84abc078ea93 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:54.327812 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c0d9b6ed-c83d-4cb3-9342-84abc078ea93 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:54.338592 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c0d9b6ed-c83d-4cb3-9342-84abc078ea93 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:54.339072 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c0d9b6ed-c83d-4cb3-9342-84abc078ea93 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:54.340054 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c0d9b6ed-c83d-4cb3-9342-84abc078ea93 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:54.340499 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c0d9b6ed-c83d-4cb3-9342-84abc078ea93 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:54.532697 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-c0d9b6ed-c83d-4cb3-9342-84abc078ea93 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:54.543129 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-c0d9b6ed-c83d-4cb3-9342-84abc078ea93 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:54.546488 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-c0d9b6ed-c83d-4cb3-9342-84abc078ea93 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:54.550307 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-c0d9b6ed-c83d-4cb3-9342-84abc078ea93 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1740 microversion: 2.20 time: 0.228697 Jul 28 04:06:54.551178 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 389/836] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:54 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:06:55.581714 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-46b98358-dc70-4a5c-92ae-df3f97cbcea9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:55.583129 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-46b98358-dc70-4a5c-92ae-df3f97cbcea9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:55.590512 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-46b98358-dc70-4a5c-92ae-df3f97cbcea9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:55.591126 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-46b98358-dc70-4a5c-92ae-df3f97cbcea9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:55.592166 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-46b98358-dc70-4a5c-92ae-df3f97cbcea9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:55.592866 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-46b98358-dc70-4a5c-92ae-df3f97cbcea9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:55.781498 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-46b98358-dc70-4a5c-92ae-df3f97cbcea9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:55.792688 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-46b98358-dc70-4a5c-92ae-df3f97cbcea9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:55.794686 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-46b98358-dc70-4a5c-92ae-df3f97cbcea9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:55.796109 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-46b98358-dc70-4a5c-92ae-df3f97cbcea9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1740 microversion: 2.20 time: 0.220062 Jul 28 04:06:55.796899 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 448/837] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:55 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1740 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:06:56.821776 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-6f95d59b-2258-45f9-abc7-a379c901b3ac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:56.822543 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-6f95d59b-2258-45f9-abc7-a379c901b3ac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:56.831936 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6f95d59b-2258-45f9-abc7-a379c901b3ac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:56.832711 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6f95d59b-2258-45f9-abc7-a379c901b3ac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:56.833694 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6f95d59b-2258-45f9-abc7-a379c901b3ac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:56.834194 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6f95d59b-2258-45f9-abc7-a379c901b3ac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:56.987874 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-6f95d59b-2258-45f9-abc7-a379c901b3ac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:56.996247 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-6f95d59b-2258-45f9-abc7-a379c901b3ac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:56.997906 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-6f95d59b-2258-45f9-abc7-a379c901b3ac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:56.999206 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-6f95d59b-2258-45f9-abc7-a379c901b3ac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1740 microversion: 2.20 time: 0.181645 Jul 28 04:06:56.999869 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 390/838] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:56 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1740 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:06:58.023857 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-eff0d8c7-2995-4a86-8d65-f307f6de22e0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:58.024484 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-eff0d8c7-2995-4a86-8d65-f307f6de22e0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:58.031613 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-eff0d8c7-2995-4a86-8d65-f307f6de22e0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:58.032596 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-eff0d8c7-2995-4a86-8d65-f307f6de22e0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:58.033762 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-eff0d8c7-2995-4a86-8d65-f307f6de22e0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:58.034315 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-eff0d8c7-2995-4a86-8d65-f307f6de22e0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:58.190874 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-eff0d8c7-2995-4a86-8d65-f307f6de22e0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:58.201288 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-eff0d8c7-2995-4a86-8d65-f307f6de22e0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:58.202981 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-eff0d8c7-2995-4a86-8d65-f307f6de22e0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:58.204276 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-eff0d8c7-2995-4a86-8d65-f307f6de22e0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1740 microversion: 2.20 time: 0.184362 Jul 28 04:06:58.204869 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 449/839] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:58 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1740 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:06:59.232374 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-32875cf3-d694-4894-89cc-eb3e3b5d1a69 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:06:59.234524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-32875cf3-d694-4894-89cc-eb3e3b5d1a69 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:06:59.248880 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-32875cf3-d694-4894-89cc-eb3e3b5d1a69 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:59.252500 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-32875cf3-d694-4894-89cc-eb3e3b5d1a69 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:59.253498 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-32875cf3-d694-4894-89cc-eb3e3b5d1a69 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:06:59.254047 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-32875cf3-d694-4894-89cc-eb3e3b5d1a69 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:06:59.424484 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-32875cf3-d694-4894-89cc-eb3e3b5d1a69 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:59.433833 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-32875cf3-d694-4894-89cc-eb3e3b5d1a69 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:59.435423 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-32875cf3-d694-4894-89cc-eb3e3b5d1a69 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:06:59.436871 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-32875cf3-d694-4894-89cc-eb3e3b5d1a69 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1740 microversion: 2.20 time: 0.208804 Jul 28 04:06:59.437636 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 391/840] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:06:59 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1740 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:00.461317 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8c4cd70d-522c-4553-8914-533c7dc4c91f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:00.462726 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8c4cd70d-522c-4553-8914-533c7dc4c91f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:00.470137 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8c4cd70d-522c-4553-8914-533c7dc4c91f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:00.470927 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8c4cd70d-522c-4553-8914-533c7dc4c91f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:00.471959 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8c4cd70d-522c-4553-8914-533c7dc4c91f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:00.472750 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8c4cd70d-522c-4553-8914-533c7dc4c91f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:00.653743 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8c4cd70d-522c-4553-8914-533c7dc4c91f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:00.665839 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8c4cd70d-522c-4553-8914-533c7dc4c91f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:00.667436 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8c4cd70d-522c-4553-8914-533c7dc4c91f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:00.668652 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8c4cd70d-522c-4553-8914-533c7dc4c91f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1740 microversion: 2.20 time: 0.211383 Jul 28 04:07:00.676826 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 450/841] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:00 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1740 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:01.693566 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-5d750322-70fc-4bee-b121-5c2866bcc0d7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:01.695522 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-5d750322-70fc-4bee-b121-5c2866bcc0d7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:01.703897 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5d750322-70fc-4bee-b121-5c2866bcc0d7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:01.704718 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5d750322-70fc-4bee-b121-5c2866bcc0d7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:01.705730 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5d750322-70fc-4bee-b121-5c2866bcc0d7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:01.706656 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5d750322-70fc-4bee-b121-5c2866bcc0d7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:01.887728 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-5d750322-70fc-4bee-b121-5c2866bcc0d7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:01.901707 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-5d750322-70fc-4bee-b121-5c2866bcc0d7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:01.903621 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-5d750322-70fc-4bee-b121-5c2866bcc0d7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:01.905452 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-5d750322-70fc-4bee-b121-5c2866bcc0d7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1740 microversion: 2.20 time: 0.216247 Jul 28 04:07:01.921254 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 392/842] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:01 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1740 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:02.930993 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-27c4f768-4697-48d3-b751-68a1dbf32dac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:02.931781 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-27c4f768-4697-48d3-b751-68a1dbf32dac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:02.944168 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-27c4f768-4697-48d3-b751-68a1dbf32dac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:02.944627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-27c4f768-4697-48d3-b751-68a1dbf32dac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:02.945583 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-27c4f768-4697-48d3-b751-68a1dbf32dac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:02.946748 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-27c4f768-4697-48d3-b751-68a1dbf32dac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:03.186676 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-27c4f768-4697-48d3-b751-68a1dbf32dac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:03.197530 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-27c4f768-4697-48d3-b751-68a1dbf32dac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:03.199346 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-27c4f768-4697-48d3-b751-68a1dbf32dac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:03.200813 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-27c4f768-4697-48d3-b751-68a1dbf32dac tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1740 microversion: 2.20 time: 0.275169 Jul 28 04:07:03.202053 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 451/843] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:02 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1740 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:04.225074 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-f2531514-e8d5-461d-a582-0a0b156137c6 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:04.225738 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-f2531514-e8d5-461d-a582-0a0b156137c6 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:04.233320 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f2531514-e8d5-461d-a582-0a0b156137c6 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:04.233778 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f2531514-e8d5-461d-a582-0a0b156137c6 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:04.234565 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f2531514-e8d5-461d-a582-0a0b156137c6 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:04.235858 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f2531514-e8d5-461d-a582-0a0b156137c6 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:04.584139 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-f2531514-e8d5-461d-a582-0a0b156137c6 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:04.592223 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-f2531514-e8d5-461d-a582-0a0b156137c6 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:04.593751 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-f2531514-e8d5-461d-a582-0a0b156137c6 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:04.595260 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-f2531514-e8d5-461d-a582-0a0b156137c6 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1722 microversion: 2.20 time: 0.374189 Jul 28 04:07:04.595997 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 393/844] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:04 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1722 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:05.622525 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8dbda73d-c0f2-4d85-a122-5033efa2de72 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:05.624458 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8dbda73d-c0f2-4d85-a122-5033efa2de72 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:05.634352 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8dbda73d-c0f2-4d85-a122-5033efa2de72 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:05.635107 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8dbda73d-c0f2-4d85-a122-5033efa2de72 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:05.636215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8dbda73d-c0f2-4d85-a122-5033efa2de72 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:05.636802 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8dbda73d-c0f2-4d85-a122-5033efa2de72 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:05.826226 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8dbda73d-c0f2-4d85-a122-5033efa2de72 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:05.835988 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8dbda73d-c0f2-4d85-a122-5033efa2de72 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:05.837496 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8dbda73d-c0f2-4d85-a122-5033efa2de72 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:05.838726 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8dbda73d-c0f2-4d85-a122-5033efa2de72 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1722 microversion: 2.20 time: 0.223170 Jul 28 04:07:05.839323 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 452/845] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:05 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1722 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:06.864178 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-dd5e91d0-be2f-47b2-ad08-cebf34a00b31 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:06.864892 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-dd5e91d0-be2f-47b2-ad08-cebf34a00b31 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:06.879197 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dd5e91d0-be2f-47b2-ad08-cebf34a00b31 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:06.879647 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dd5e91d0-be2f-47b2-ad08-cebf34a00b31 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:06.881735 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dd5e91d0-be2f-47b2-ad08-cebf34a00b31 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:06.883350 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dd5e91d0-be2f-47b2-ad08-cebf34a00b31 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:07.159628 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-dd5e91d0-be2f-47b2-ad08-cebf34a00b31 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:07.172820 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-dd5e91d0-be2f-47b2-ad08-cebf34a00b31 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:07.174618 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-dd5e91d0-be2f-47b2-ad08-cebf34a00b31 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:07.175900 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-dd5e91d0-be2f-47b2-ad08-cebf34a00b31 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1722 microversion: 2.20 time: 0.318123 Jul 28 04:07:07.176519 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 394/846] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:06 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1722 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:08.102275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-8fa0a151-ab41-4f13-bf05-4cebd7db956a req-6eaf16cc-4716-4e09-a160-663fd9a5ac42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "489708ab-f8bf-4f93-aa7a-907559b15d01", "name": "network-vif-unplugged", "status": "completed", "tag": "0e9bfde3-9675-4314-9b59-4d7ba4f8ddf3"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:07:08.116189 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-8fa0a151-ab41-4f13-bf05-4cebd7db956a req-6eaf16cc-4716-4e09-a160-663fd9a5ac42 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:08.116861 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-8fa0a151-ab41-4f13-bf05-4cebd7db956a req-6eaf16cc-4716-4e09-a160-663fd9a5ac42 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:08.135132 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.compute.server_external_events [req-8fa0a151-ab41-4f13-bf05-4cebd7db956a req-6eaf16cc-4716-4e09-a160-663fd9a5ac42 service nova] Unable to find a host for instance 489708ab-f8bf-4f93-aa7a-907559b15d01. Dropping event network-vif-unplugged {{(pid=118187) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 04:07:08.136704 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-8fa0a151-ab41-4f13-bf05-4cebd7db956a req-6eaf16cc-4716-4e09-a160-663fd9a5ac42 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.038567 Jul 28 04:07:08.137489 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 453/847] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jul 28 04:07:08.200383 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-21cc78b2-a940-409d-a704-d216ca828f0c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:08.200992 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-21cc78b2-a940-409d-a704-d216ca828f0c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:08.209305 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-21cc78b2-a940-409d-a704-d216ca828f0c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:08.210007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-21cc78b2-a940-409d-a704-d216ca828f0c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:08.210860 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-21cc78b2-a940-409d-a704-d216ca828f0c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:08.211516 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-21cc78b2-a940-409d-a704-d216ca828f0c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:08.214522 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=88 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:08.352544 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-21cc78b2-a940-409d-a704-d216ca828f0c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:08.361509 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-21cc78b2-a940-409d-a704-d216ca828f0c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:08.363054 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-21cc78b2-a940-409d-a704-d216ca828f0c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:08.364374 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-21cc78b2-a940-409d-a704-d216ca828f0c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1665 microversion: 2.20 time: 0.167865 Jul 28 04:07:08.364925 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 395/848] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:08 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1665 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:08.387230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-674543c1-f229-43d8-a143-bb5c30bcff3d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d60c0f65-6735-4e25-bfc8-00ff4de7cd96"}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:07:08.389554 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-674543c1-f229-43d8-a143-bb5c30bcff3d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:08.395798 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-674543c1-f229-43d8-a143-bb5c30bcff3d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:08.396288 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-674543c1-f229-43d8-a143-bb5c30bcff3d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:08.397065 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-674543c1-f229-43d8-a143-bb5c30bcff3d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:08.397502 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-674543c1-f229-43d8-a143-bb5c30bcff3d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:08.789462 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-674543c1-f229-43d8-a143-bb5c30bcff3d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "POST /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.402626 Jul 28 04:07:08.792542 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 454/849] 10.222.0.46 () {62 vars in 1364 bytes} [Thu Jul 28 04:07:08 2022] POST /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01/os-volume_attachments => generated 188 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 28 04:07:08.940042 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-dd8764ae-8362-437b-b452-ef4e7104b09e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:07:08.940636 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-dd8764ae-8362-437b-b452-ef4e7104b09e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:08.948222 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dd8764ae-8362-437b-b452-ef4e7104b09e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:08.949385 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dd8764ae-8362-437b-b452-ef4e7104b09e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:08.950680 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dd8764ae-8362-437b-b452-ef4e7104b09e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:08.951481 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dd8764ae-8362-437b-b452-ef4e7104b09e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:09.026700 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-dd8764ae-8362-437b-b452-ef4e7104b09e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118186) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 04:07:09.107163 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-dd8764ae-8362-437b-b452-ef4e7104b09e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "POST /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01/action" status: 202 len: 0 microversion: 2.20 time: 0.171021 Jul 28 04:07:09.118260 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e7a3a4c9-fdf0-4648-811a-c25936adc41b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:09.118713 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e7a3a4c9-fdf0-4648-811a-c25936adc41b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:09.123786 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 396/850] 10.222.0.46 () {62 vars in 1319 bytes} [Thu Jul 28 04:07:08 2022] POST /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01/action => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:07:09.128676 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e7a3a4c9-fdf0-4648-811a-c25936adc41b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:09.129012 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e7a3a4c9-fdf0-4648-811a-c25936adc41b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:09.129531 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e7a3a4c9-fdf0-4648-811a-c25936adc41b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:09.130038 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e7a3a4c9-fdf0-4648-811a-c25936adc41b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:09.427534 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e7a3a4c9-fdf0-4648-811a-c25936adc41b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:09.439516 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e7a3a4c9-fdf0-4648-811a-c25936adc41b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:09.441053 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e7a3a4c9-fdf0-4648-811a-c25936adc41b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:09.442232 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e7a3a4c9-fdf0-4648-811a-c25936adc41b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1751 microversion: 2.20 time: 0.329217 Jul 28 04:07:09.447569 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 455/851] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:09 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1751 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:07:10.476698 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-87c5401a-1dd1-4731-b1c7-c23bd3142e5a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:10.477311 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-87c5401a-1dd1-4731-b1c7-c23bd3142e5a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:10.492452 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-87c5401a-1dd1-4731-b1c7-c23bd3142e5a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:10.493469 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-87c5401a-1dd1-4731-b1c7-c23bd3142e5a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:10.494273 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-87c5401a-1dd1-4731-b1c7-c23bd3142e5a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:10.497253 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-87c5401a-1dd1-4731-b1c7-c23bd3142e5a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:10.846985 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-87c5401a-1dd1-4731-b1c7-c23bd3142e5a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:10.856022 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-87c5401a-1dd1-4731-b1c7-c23bd3142e5a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:10.860632 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-87c5401a-1dd1-4731-b1c7-c23bd3142e5a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:10.862485 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-87c5401a-1dd1-4731-b1c7-c23bd3142e5a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1751 microversion: 2.20 time: 0.388847 Jul 28 04:07:10.865691 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 397/852] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:10 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1751 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:11.906503 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-1c55e047-7045-4227-91da-81ae0f0017e2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:11.907364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-1c55e047-7045-4227-91da-81ae0f0017e2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:11.919874 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1c55e047-7045-4227-91da-81ae0f0017e2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:11.925649 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1c55e047-7045-4227-91da-81ae0f0017e2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:11.926731 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1c55e047-7045-4227-91da-81ae0f0017e2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:11.927387 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1c55e047-7045-4227-91da-81ae0f0017e2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:12.176293 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1c55e047-7045-4227-91da-81ae0f0017e2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:12.195366 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1c55e047-7045-4227-91da-81ae0f0017e2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:12.201490 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1c55e047-7045-4227-91da-81ae0f0017e2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:12.206826 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-1c55e047-7045-4227-91da-81ae0f0017e2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1753 microversion: 2.20 time: 0.312956 Jul 28 04:07:12.222811 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 456/853] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:11 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1753 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:13.239228 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-eb458049-0d78-4ce5-a453-7f9bf0fdc869 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:13.240582 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-eb458049-0d78-4ce5-a453-7f9bf0fdc869 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:13.253893 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-eb458049-0d78-4ce5-a453-7f9bf0fdc869 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:13.256666 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-eb458049-0d78-4ce5-a453-7f9bf0fdc869 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:13.258262 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-eb458049-0d78-4ce5-a453-7f9bf0fdc869 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:13.258619 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-eb458049-0d78-4ce5-a453-7f9bf0fdc869 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:13.646133 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-eb458049-0d78-4ce5-a453-7f9bf0fdc869 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:13.659875 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-eb458049-0d78-4ce5-a453-7f9bf0fdc869 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:13.662960 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-eb458049-0d78-4ce5-a453-7f9bf0fdc869 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:13.667738 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-eb458049-0d78-4ce5-a453-7f9bf0fdc869 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.433474 Jul 28 04:07:13.669304 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 398/854] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:13 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:14.694656 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3acf3af4-e37c-4431-8f3c-41821b6f227c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:14.695419 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3acf3af4-e37c-4431-8f3c-41821b6f227c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:14.702663 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3acf3af4-e37c-4431-8f3c-41821b6f227c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:14.705494 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3acf3af4-e37c-4431-8f3c-41821b6f227c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:14.709961 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3acf3af4-e37c-4431-8f3c-41821b6f227c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:14.715366 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3acf3af4-e37c-4431-8f3c-41821b6f227c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:14.725058 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:15.157654 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3acf3af4-e37c-4431-8f3c-41821b6f227c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:15.176290 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3acf3af4-e37c-4431-8f3c-41821b6f227c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:15.178074 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3acf3af4-e37c-4431-8f3c-41821b6f227c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:15.179738 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3acf3af4-e37c-4431-8f3c-41821b6f227c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.490282 Jul 28 04:07:15.200317 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 457/855] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:14 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:16.207672 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-d8dddb78-183f-4dbc-a53c-2c292a656a95 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:16.209150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-d8dddb78-183f-4dbc-a53c-2c292a656a95 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:16.219691 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d8dddb78-183f-4dbc-a53c-2c292a656a95 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:16.220766 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d8dddb78-183f-4dbc-a53c-2c292a656a95 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:16.222431 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d8dddb78-183f-4dbc-a53c-2c292a656a95 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:16.223183 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d8dddb78-183f-4dbc-a53c-2c292a656a95 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:16.490679 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-d8dddb78-183f-4dbc-a53c-2c292a656a95 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:16.507200 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-d8dddb78-183f-4dbc-a53c-2c292a656a95 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:16.509226 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-d8dddb78-183f-4dbc-a53c-2c292a656a95 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:16.510695 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-d8dddb78-183f-4dbc-a53c-2c292a656a95 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.307723 Jul 28 04:07:16.512278 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 399/856] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:16 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:17.539662 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d2994d7b-0bd2-4d9a-8eec-3dfc4c877b4f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:17.542176 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d2994d7b-0bd2-4d9a-8eec-3dfc4c877b4f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:17.567886 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d2994d7b-0bd2-4d9a-8eec-3dfc4c877b4f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:17.570185 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d2994d7b-0bd2-4d9a-8eec-3dfc4c877b4f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:17.573164 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d2994d7b-0bd2-4d9a-8eec-3dfc4c877b4f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:17.575913 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d2994d7b-0bd2-4d9a-8eec-3dfc4c877b4f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:17.777441 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d2994d7b-0bd2-4d9a-8eec-3dfc4c877b4f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:17.789042 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d2994d7b-0bd2-4d9a-8eec-3dfc4c877b4f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:17.791516 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d2994d7b-0bd2-4d9a-8eec-3dfc4c877b4f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:17.793064 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d2994d7b-0bd2-4d9a-8eec-3dfc4c877b4f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.260795 Jul 28 04:07:17.794166 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 458/857] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:17 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:18.819667 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a84baabd-e93b-4469-9d5b-d726ea0ac19a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:18.820291 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-a84baabd-e93b-4469-9d5b-d726ea0ac19a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:18.827139 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a84baabd-e93b-4469-9d5b-d726ea0ac19a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:18.827596 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a84baabd-e93b-4469-9d5b-d726ea0ac19a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:18.828419 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a84baabd-e93b-4469-9d5b-d726ea0ac19a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:18.828854 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a84baabd-e93b-4469-9d5b-d726ea0ac19a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:19.001392 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-a84baabd-e93b-4469-9d5b-d726ea0ac19a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:19.011735 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-a84baabd-e93b-4469-9d5b-d726ea0ac19a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:19.013503 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-a84baabd-e93b-4469-9d5b-d726ea0ac19a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:19.014924 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-a84baabd-e93b-4469-9d5b-d726ea0ac19a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.199484 Jul 28 04:07:19.027505 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 400/858] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:18 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:20.040811 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-0ddb1b88-65d8-49b2-ac41-b3f645a553af tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:20.042676 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-0ddb1b88-65d8-49b2-ac41-b3f645a553af tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:20.045569 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=28 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:20.061135 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0ddb1b88-65d8-49b2-ac41-b3f645a553af tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:20.061947 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0ddb1b88-65d8-49b2-ac41-b3f645a553af tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:20.063476 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0ddb1b88-65d8-49b2-ac41-b3f645a553af tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:20.064426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0ddb1b88-65d8-49b2-ac41-b3f645a553af tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:20.373212 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-0ddb1b88-65d8-49b2-ac41-b3f645a553af tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:20.389876 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-0ddb1b88-65d8-49b2-ac41-b3f645a553af tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:20.392852 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-0ddb1b88-65d8-49b2-ac41-b3f645a553af tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:20.394155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-0ddb1b88-65d8-49b2-ac41-b3f645a553af tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.358057 Jul 28 04:07:20.395101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 459/859] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:20 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:21.418435 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-62d13ba1-aad9-4099-abf5-6dddbd4f1804 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:21.419225 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-62d13ba1-aad9-4099-abf5-6dddbd4f1804 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:21.429265 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:21.436204 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-62d13ba1-aad9-4099-abf5-6dddbd4f1804 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:21.442587 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-62d13ba1-aad9-4099-abf5-6dddbd4f1804 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:21.447653 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-62d13ba1-aad9-4099-abf5-6dddbd4f1804 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:21.452353 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-62d13ba1-aad9-4099-abf5-6dddbd4f1804 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:21.722076 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-62d13ba1-aad9-4099-abf5-6dddbd4f1804 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:21.733684 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-62d13ba1-aad9-4099-abf5-6dddbd4f1804 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:21.740645 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-62d13ba1-aad9-4099-abf5-6dddbd4f1804 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:21.742548 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-62d13ba1-aad9-4099-abf5-6dddbd4f1804 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.328520 Jul 28 04:07:21.745656 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 401/860] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:21 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:22.773517 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-1059301f-c2a8-4104-bcd2-1825859d29e3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:22.774507 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-1059301f-c2a8-4104-bcd2-1825859d29e3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:22.788716 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1059301f-c2a8-4104-bcd2-1825859d29e3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:22.789906 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1059301f-c2a8-4104-bcd2-1825859d29e3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:22.790804 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1059301f-c2a8-4104-bcd2-1825859d29e3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:22.791633 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1059301f-c2a8-4104-bcd2-1825859d29e3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:23.055654 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1059301f-c2a8-4104-bcd2-1825859d29e3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:23.067470 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1059301f-c2a8-4104-bcd2-1825859d29e3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:23.069542 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1059301f-c2a8-4104-bcd2-1825859d29e3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:23.071240 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-1059301f-c2a8-4104-bcd2-1825859d29e3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.301497 Jul 28 04:07:23.072328 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 460/861] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:22 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:24.099555 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-1748b74b-7fac-45fe-a6b6-fabd85eec635 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:24.101240 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-1748b74b-7fac-45fe-a6b6-fabd85eec635 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:24.109641 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1748b74b-7fac-45fe-a6b6-fabd85eec635 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:24.110524 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1748b74b-7fac-45fe-a6b6-fabd85eec635 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:24.111725 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1748b74b-7fac-45fe-a6b6-fabd85eec635 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:24.112330 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1748b74b-7fac-45fe-a6b6-fabd85eec635 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:24.335929 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-1748b74b-7fac-45fe-a6b6-fabd85eec635 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:24.352356 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-1748b74b-7fac-45fe-a6b6-fabd85eec635 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:24.354301 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-1748b74b-7fac-45fe-a6b6-fabd85eec635 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:24.356132 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-1748b74b-7fac-45fe-a6b6-fabd85eec635 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.260407 Jul 28 04:07:24.357069 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 402/862] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:24 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:25.386556 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-dd7bbeae-f878-4b64-aaa0-49899f281e2c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:25.388582 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-dd7bbeae-f878-4b64-aaa0-49899f281e2c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:25.411260 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dd7bbeae-f878-4b64-aaa0-49899f281e2c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:25.411787 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dd7bbeae-f878-4b64-aaa0-49899f281e2c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:25.412784 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dd7bbeae-f878-4b64-aaa0-49899f281e2c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:25.416178 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dd7bbeae-f878-4b64-aaa0-49899f281e2c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:25.672353 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-dd7bbeae-f878-4b64-aaa0-49899f281e2c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:25.686065 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-dd7bbeae-f878-4b64-aaa0-49899f281e2c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:25.689571 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-dd7bbeae-f878-4b64-aaa0-49899f281e2c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:25.696447 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-dd7bbeae-f878-4b64-aaa0-49899f281e2c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.314968 Jul 28 04:07:25.727385 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 461/863] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:25 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:26.778952 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-07215e64-ba0e-44cf-8f69-3316fdb83ecb tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:26.779803 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-07215e64-ba0e-44cf-8f69-3316fdb83ecb tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:26.803830 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-07215e64-ba0e-44cf-8f69-3316fdb83ecb tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:26.809641 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-07215e64-ba0e-44cf-8f69-3316fdb83ecb tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:26.811171 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-07215e64-ba0e-44cf-8f69-3316fdb83ecb tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:26.821928 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-07215e64-ba0e-44cf-8f69-3316fdb83ecb tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:27.129050 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-07215e64-ba0e-44cf-8f69-3316fdb83ecb tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:27.141031 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-07215e64-ba0e-44cf-8f69-3316fdb83ecb tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:27.143404 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-07215e64-ba0e-44cf-8f69-3316fdb83ecb tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:27.145029 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-07215e64-ba0e-44cf-8f69-3316fdb83ecb tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.393996 Jul 28 04:07:27.146115 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 403/864] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:26 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:28.173226 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-447ec90a-5d8d-45a9-becc-68770673611f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:28.173887 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-447ec90a-5d8d-45a9-becc-68770673611f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:28.182596 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-447ec90a-5d8d-45a9-becc-68770673611f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:28.182870 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-447ec90a-5d8d-45a9-becc-68770673611f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:28.183733 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-447ec90a-5d8d-45a9-becc-68770673611f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:28.184339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-447ec90a-5d8d-45a9-becc-68770673611f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:28.206751 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-b7274465-25ce-4187-a9d6-ac3eea807e09 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Action: 'create', calling method: .version_select at 0x7fa6ee092a60>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1267502620", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoUBAfwiTPHKb5ocBoZngiYS2GQuQ13GXTU9OIOdR0pfASllm0+5KyMUmW0Lzb0ne+EQuRaF8ajzcWLikifFMjwoun0OuO1+qTWaeZB0WbDxXzYlRnQXIATUsE7BW6b+g=="}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:07:28.223510 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-b7274465-25ce-4187-a9d6-ac3eea807e09 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Getting quotas for project 346eb7e46ec54cf087d8b39379cf5129. Resources: {'key_pairs'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:07:28.227576 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-b7274465-25ce-4187-a9d6-ac3eea807e09 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Getting quotas for user 9d30603fefe44a0c9dbed8c170071b09 and project 346eb7e46ec54cf087d8b39379cf5129. Resources: {'key_pairs'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:07:28.255127 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-b7274465-25ce-4187-a9d6-ac3eea807e09 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.052670 Jul 28 04:07:28.256123 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 404/865] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 04:07:28 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:07:28.345618 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-447ec90a-5d8d-45a9-becc-68770673611f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:28.356906 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-447ec90a-5d8d-45a9-becc-68770673611f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:28.358919 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-447ec90a-5d8d-45a9-becc-68770673611f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:28.360310 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-447ec90a-5d8d-45a9-becc-68770673611f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.192710 Jul 28 04:07:28.372125 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 462/866] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:28 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:07:28.375390 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-cef2a2c2-1343-476a-a228-d8319aa3d759 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-996682385", "imageRef": "afd9848b-f750-4399-bae2-21ed061ff5ef", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1267502620", "networks": [{"uuid": "ef444337-e761-4913-ae0f-e627d8ef8048"}]}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:07:28.433700 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.network.neutron [None req-cef2a2c2-1343-476a-a228-d8319aa3d759 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] validate_networks() for [('ef444337-e761-4913-ae0f-e627d8ef8048', None, None, None, None, None)] {{(pid=118186) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:07:28.818546 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-cef2a2c2-1343-476a-a228-d8319aa3d759 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Flavor limits 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:07:28.819008 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-cef2a2c2-1343-476a-a228-d8319aa3d759 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Image limits 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:07:28.819481 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-cef2a2c2-1343-476a-a228-d8319aa3d759 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Flavor pref 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:07:28.819879 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-cef2a2c2-1343-476a-a228-d8319aa3d759 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Image pref 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:07:28.820285 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-cef2a2c2-1343-476a-a228-d8319aa3d759 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:07:28.828975 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-cef2a2c2-1343-476a-a228-d8319aa3d759 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:28.829414 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-cef2a2c2-1343-476a-a228-d8319aa3d759 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:28.830203 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-cef2a2c2-1343-476a-a228-d8319aa3d759 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:28.830638 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-cef2a2c2-1343-476a-a228-d8319aa3d759 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:28.847626 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-cef2a2c2-1343-476a-a228-d8319aa3d759 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Getting quotas for project 346eb7e46ec54cf087d8b39379cf5129. Resources: {'instances', 'cores', 'ram'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:07:28.851663 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-cef2a2c2-1343-476a-a228-d8319aa3d759 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Getting quotas for user 9d30603fefe44a0c9dbed8c170071b09 and project 346eb7e46ec54cf087d8b39379cf5129. Resources: {'instances', 'cores', 'ram'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:07:28.864425 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-cef2a2c2-1343-476a-a228-d8319aa3d759 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Going to run 1 instances... {{(pid=118186) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:07:28.866889 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-cef2a2c2-1343-476a-a228-d8319aa3d759 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='afd9848b-f750-4399-bae2-21ed061ff5ef',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:07:28.914382 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-cef2a2c2-1343-476a-a228-d8319aa3d759 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.545031 Jul 28 04:07:28.915406 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 405/867] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 04:07:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 547 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:07:28.926987 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fe66a5b2-4643-4d06-a96f-29146a18e87b tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:28.927484 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-fe66a5b2-4643-4d06-a96f-29146a18e87b tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:28.988055 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-fe66a5b2-4643-4d06-a96f-29146a18e87b tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:28.995399 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-fe66a5b2-4643-4d06-a96f-29146a18e87b tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1258 microversion: 2.1 time: 0.072866 Jul 28 04:07:28.998913 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 463/868] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:28 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1258 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:07:29.388009 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-6e6bcd87-65fb-45c4-aa74-4b3414a7e053 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:29.388719 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-6e6bcd87-65fb-45c4-aa74-4b3414a7e053 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:29.396771 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6e6bcd87-65fb-45c4-aa74-4b3414a7e053 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:29.397244 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6e6bcd87-65fb-45c4-aa74-4b3414a7e053 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:29.398078 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6e6bcd87-65fb-45c4-aa74-4b3414a7e053 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:29.398523 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6e6bcd87-65fb-45c4-aa74-4b3414a7e053 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:29.534373 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-6e6bcd87-65fb-45c4-aa74-4b3414a7e053 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:29.543689 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-6e6bcd87-65fb-45c4-aa74-4b3414a7e053 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:29.545372 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-6e6bcd87-65fb-45c4-aa74-4b3414a7e053 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:29.546586 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-6e6bcd87-65fb-45c4-aa74-4b3414a7e053 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.163086 Jul 28 04:07:29.547180 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 406/869] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:29 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:30.017362 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a9bc8523-ee79-4be4-9bfb-998a694c584d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:30.017998 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a9bc8523-ee79-4be4-9bfb-998a694c584d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:30.024607 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a9bc8523-ee79-4be4-9bfb-998a694c584d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:30.025063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a9bc8523-ee79-4be4-9bfb-998a694c584d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:30.025835 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a9bc8523-ee79-4be4-9bfb-998a694c584d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:30.026273 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a9bc8523-ee79-4be4-9bfb-998a694c584d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:30.090423 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a9bc8523-ee79-4be4-9bfb-998a694c584d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:30.099423 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a9bc8523-ee79-4be4-9bfb-998a694c584d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1316 microversion: 2.1 time: 0.086860 Jul 28 04:07:30.100011 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 464/870] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:30 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1316 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:30.570675 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-36f7908a-8ca8-4f51-b6d9-e043cc2befd5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:30.572008 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-36f7908a-8ca8-4f51-b6d9-e043cc2befd5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:30.596678 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-36f7908a-8ca8-4f51-b6d9-e043cc2befd5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:30.596883 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-36f7908a-8ca8-4f51-b6d9-e043cc2befd5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:30.597716 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-36f7908a-8ca8-4f51-b6d9-e043cc2befd5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:30.598162 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-36f7908a-8ca8-4f51-b6d9-e043cc2befd5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:30.850280 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-36f7908a-8ca8-4f51-b6d9-e043cc2befd5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:30.859317 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-36f7908a-8ca8-4f51-b6d9-e043cc2befd5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:30.868859 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-36f7908a-8ca8-4f51-b6d9-e043cc2befd5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:30.871597 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-36f7908a-8ca8-4f51-b6d9-e043cc2befd5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.305597 Jul 28 04:07:30.891357 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 407/871] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:30 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:31.123111 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-79765e1e-79ab-4820-8bb0-328a7b362aaf tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:31.124898 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-79765e1e-79ab-4820-8bb0-328a7b362aaf tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:31.136151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-79765e1e-79ab-4820-8bb0-328a7b362aaf tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:31.139348 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-79765e1e-79ab-4820-8bb0-328a7b362aaf tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:31.140920 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-79765e1e-79ab-4820-8bb0-328a7b362aaf tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:31.143453 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-79765e1e-79ab-4820-8bb0-328a7b362aaf tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:31.368837 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-79765e1e-79ab-4820-8bb0-328a7b362aaf tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:31.389118 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-79765e1e-79ab-4820-8bb0-328a7b362aaf tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1358 microversion: 2.1 time: 0.269237 Jul 28 04:07:31.391638 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 465/872] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:31 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1358 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:31.899631 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-7c88e6bf-7ba6-4386-bba5-4a062c8b3c86 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:31.900285 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-7c88e6bf-7ba6-4386-bba5-4a062c8b3c86 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:31.906996 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7c88e6bf-7ba6-4386-bba5-4a062c8b3c86 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:31.907451 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7c88e6bf-7ba6-4386-bba5-4a062c8b3c86 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:31.908226 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7c88e6bf-7ba6-4386-bba5-4a062c8b3c86 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:31.908672 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7c88e6bf-7ba6-4386-bba5-4a062c8b3c86 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:32.071058 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-7c88e6bf-7ba6-4386-bba5-4a062c8b3c86 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:32.081420 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-7c88e6bf-7ba6-4386-bba5-4a062c8b3c86 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:32.083722 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-7c88e6bf-7ba6-4386-bba5-4a062c8b3c86 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:32.085359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-7c88e6bf-7ba6-4386-bba5-4a062c8b3c86 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.189657 Jul 28 04:07:32.098832 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 408/873] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:31 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:32.419796 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2756b428-0180-4d59-91dc-2411ab33474b tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:32.422301 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-2756b428-0180-4d59-91dc-2411ab33474b tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:32.430069 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2756b428-0180-4d59-91dc-2411ab33474b tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:32.431025 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2756b428-0180-4d59-91dc-2411ab33474b tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:32.431868 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2756b428-0180-4d59-91dc-2411ab33474b tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:32.445275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2756b428-0180-4d59-91dc-2411ab33474b tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:32.614203 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-2756b428-0180-4d59-91dc-2411ab33474b tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:32.623170 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-2756b428-0180-4d59-91dc-2411ab33474b tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1358 microversion: 2.1 time: 0.213818 Jul 28 04:07:32.635138 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 466/874] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:32 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1358 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:33.110253 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-fcc9e870-4ba6-4bb5-8578-82f909e89a9c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:33.110987 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-fcc9e870-4ba6-4bb5-8578-82f909e89a9c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:33.117820 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fcc9e870-4ba6-4bb5-8578-82f909e89a9c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:33.118561 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fcc9e870-4ba6-4bb5-8578-82f909e89a9c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:33.119659 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fcc9e870-4ba6-4bb5-8578-82f909e89a9c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:33.120277 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fcc9e870-4ba6-4bb5-8578-82f909e89a9c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:33.281850 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-fcc9e870-4ba6-4bb5-8578-82f909e89a9c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:33.291722 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-fcc9e870-4ba6-4bb5-8578-82f909e89a9c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:33.293598 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-fcc9e870-4ba6-4bb5-8578-82f909e89a9c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:33.295049 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-fcc9e870-4ba6-4bb5-8578-82f909e89a9c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.189340 Jul 28 04:07:33.306955 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 409/875] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:33 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:33.662375 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-55457318-680e-45a6-a205-ded1988cd16b tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:33.663282 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-55457318-680e-45a6-a205-ded1988cd16b tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:33.683893 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55457318-680e-45a6-a205-ded1988cd16b tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:33.684735 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55457318-680e-45a6-a205-ded1988cd16b tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:33.698013 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55457318-680e-45a6-a205-ded1988cd16b tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:33.699111 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55457318-680e-45a6-a205-ded1988cd16b tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:33.882739 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-55457318-680e-45a6-a205-ded1988cd16b tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:33.899196 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-55457318-680e-45a6-a205-ded1988cd16b tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1358 microversion: 2.1 time: 0.244993 Jul 28 04:07:33.900157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 467/876] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:33 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1358 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:34.321120 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-8cd7e7a9-ce6c-4a70-bb8a-0b7b6f318140 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:34.323356 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-8cd7e7a9-ce6c-4a70-bb8a-0b7b6f318140 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:34.335839 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8cd7e7a9-ce6c-4a70-bb8a-0b7b6f318140 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:34.336354 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8cd7e7a9-ce6c-4a70-bb8a-0b7b6f318140 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:34.337122 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8cd7e7a9-ce6c-4a70-bb8a-0b7b6f318140 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:34.337567 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-8cd7e7a9-ce6c-4a70-bb8a-0b7b6f318140 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:34.519130 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-8cd7e7a9-ce6c-4a70-bb8a-0b7b6f318140 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:34.528585 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-8cd7e7a9-ce6c-4a70-bb8a-0b7b6f318140 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:34.530231 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-8cd7e7a9-ce6c-4a70-bb8a-0b7b6f318140 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:34.532172 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-8cd7e7a9-ce6c-4a70-bb8a-0b7b6f318140 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.216054 Jul 28 04:07:34.532892 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 410/877] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:34 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:34.923690 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a2eb3fc6-6f57-4ffa-8296-f1b6025eca0c tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:34.924314 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a2eb3fc6-6f57-4ffa-8296-f1b6025eca0c tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:34.931010 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a2eb3fc6-6f57-4ffa-8296-f1b6025eca0c tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:34.931601 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a2eb3fc6-6f57-4ffa-8296-f1b6025eca0c tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:34.932429 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a2eb3fc6-6f57-4ffa-8296-f1b6025eca0c tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:34.933270 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a2eb3fc6-6f57-4ffa-8296-f1b6025eca0c tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:35.153754 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a2eb3fc6-6f57-4ffa-8296-f1b6025eca0c tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:35.168263 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a2eb3fc6-6f57-4ffa-8296-f1b6025eca0c tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1358 microversion: 2.1 time: 0.249046 Jul 28 04:07:35.180641 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 468/878] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:34 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:35.557548 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-88b4163a-db12-4783-b394-f8f2e6e16370 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:35.558204 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-88b4163a-db12-4783-b394-f8f2e6e16370 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:35.568556 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-88b4163a-db12-4783-b394-f8f2e6e16370 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:35.569374 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-88b4163a-db12-4783-b394-f8f2e6e16370 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:35.570284 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-88b4163a-db12-4783-b394-f8f2e6e16370 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:35.570976 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-88b4163a-db12-4783-b394-f8f2e6e16370 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:35.759110 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-88b4163a-db12-4783-b394-f8f2e6e16370 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:35.777115 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-88b4163a-db12-4783-b394-f8f2e6e16370 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:35.779006 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-88b4163a-db12-4783-b394-f8f2e6e16370 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:35.780510 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-88b4163a-db12-4783-b394-f8f2e6e16370 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.227002 Jul 28 04:07:35.795353 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 411/879] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:35 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:36.190259 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b2b7fb88-ee41-4f17-9628-c57760fb0b17 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:36.190930 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b2b7fb88-ee41-4f17-9628-c57760fb0b17 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:36.197772 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b2b7fb88-ee41-4f17-9628-c57760fb0b17 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:36.198233 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b2b7fb88-ee41-4f17-9628-c57760fb0b17 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:36.199183 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b2b7fb88-ee41-4f17-9628-c57760fb0b17 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:36.199650 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b2b7fb88-ee41-4f17-9628-c57760fb0b17 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:36.333066 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b2b7fb88-ee41-4f17-9628-c57760fb0b17 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:36.340544 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b2b7fb88-ee41-4f17-9628-c57760fb0b17 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1358 microversion: 2.1 time: 0.154917 Jul 28 04:07:36.341112 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 469/880] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:36 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:36.806144 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-5bd80977-e7b2-4c79-aaec-6b276218f085 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:36.819832 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-5bd80977-e7b2-4c79-aaec-6b276218f085 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:36.826510 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5bd80977-e7b2-4c79-aaec-6b276218f085 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:36.827751 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5bd80977-e7b2-4c79-aaec-6b276218f085 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:36.828530 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5bd80977-e7b2-4c79-aaec-6b276218f085 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:36.828968 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5bd80977-e7b2-4c79-aaec-6b276218f085 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:36.864065 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:37.003534 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-5bd80977-e7b2-4c79-aaec-6b276218f085 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:37.012768 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-5bd80977-e7b2-4c79-aaec-6b276218f085 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:37.014208 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-5bd80977-e7b2-4c79-aaec-6b276218f085 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:37.015572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-5bd80977-e7b2-4c79-aaec-6b276218f085 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.213309 Jul 28 04:07:37.016153 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 412/881] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:36 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:37.362229 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-18bbdf12-5ac2-4d33-8385-7dffae050987 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:37.362873 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-18bbdf12-5ac2-4d33-8385-7dffae050987 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:37.369984 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-18bbdf12-5ac2-4d33-8385-7dffae050987 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:37.370452 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-18bbdf12-5ac2-4d33-8385-7dffae050987 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:37.371255 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-18bbdf12-5ac2-4d33-8385-7dffae050987 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:37.371693 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-18bbdf12-5ac2-4d33-8385-7dffae050987 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:37.534496 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-18bbdf12-5ac2-4d33-8385-7dffae050987 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:37.547234 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-18bbdf12-5ac2-4d33-8385-7dffae050987 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1358 microversion: 2.1 time: 0.189183 Jul 28 04:07:37.566729 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 470/882] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:37 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:38.040775 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-127ed79a-2f22-4b0a-8068-cf399b3a4003 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:38.041392 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-127ed79a-2f22-4b0a-8068-cf399b3a4003 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:38.052378 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-127ed79a-2f22-4b0a-8068-cf399b3a4003 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:38.052856 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-127ed79a-2f22-4b0a-8068-cf399b3a4003 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:38.053721 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-127ed79a-2f22-4b0a-8068-cf399b3a4003 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:38.054159 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-127ed79a-2f22-4b0a-8068-cf399b3a4003 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:38.224449 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-127ed79a-2f22-4b0a-8068-cf399b3a4003 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:38.244591 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-127ed79a-2f22-4b0a-8068-cf399b3a4003 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:38.246869 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-127ed79a-2f22-4b0a-8068-cf399b3a4003 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:38.248306 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-127ed79a-2f22-4b0a-8068-cf399b3a4003 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.212205 Jul 28 04:07:38.249622 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 413/883] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:38 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:38.574289 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-1621ede5-fa32-42b3-9baa-b7852388bac7 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:38.575057 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-1621ede5-fa32-42b3-9baa-b7852388bac7 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:38.581425 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1621ede5-fa32-42b3-9baa-b7852388bac7 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:38.582096 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1621ede5-fa32-42b3-9baa-b7852388bac7 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:38.582900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1621ede5-fa32-42b3-9baa-b7852388bac7 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:38.583337 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1621ede5-fa32-42b3-9baa-b7852388bac7 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:38.716553 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1621ede5-fa32-42b3-9baa-b7852388bac7 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:38.725050 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-1621ede5-fa32-42b3-9baa-b7852388bac7 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1358 microversion: 2.1 time: 0.155346 Jul 28 04:07:38.725707 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 471/884] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:38 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:39.274896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-0920cf81-abd7-455f-a303-03d0d9cb0991 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:39.275705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-0920cf81-abd7-455f-a303-03d0d9cb0991 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:39.278681 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell0:SELECT=2 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:39.279438 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell0:SELECT=10 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:39.287418 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0920cf81-abd7-455f-a303-03d0d9cb0991 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:39.288481 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0920cf81-abd7-455f-a303-03d0d9cb0991 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:39.289500 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0920cf81-abd7-455f-a303-03d0d9cb0991 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:39.290140 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0920cf81-abd7-455f-a303-03d0d9cb0991 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:39.563167 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-0920cf81-abd7-455f-a303-03d0d9cb0991 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:39.571707 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-0920cf81-abd7-455f-a303-03d0d9cb0991 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:39.573385 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-0920cf81-abd7-455f-a303-03d0d9cb0991 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:39.574733 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-0920cf81-abd7-455f-a303-03d0d9cb0991 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.306614 Jul 28 04:07:39.575352 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 414/885] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:39 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:39.650275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-cf570488-d1ec-4787-90cc-ccb4b7a78c77 req-797df3d0-d6fb-42d7-a884-aedb4ea23d8c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b39f037b-6003-425c-bf7d-37a9432efbf7", "tag": "ec8710cf-b9f9-4fb9-a83d-176eeaf7d403"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:07:39.656713 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:39.676925 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-cf570488-d1ec-4787-90cc-ccb4b7a78c77 req-797df3d0-d6fb-42d7-a884-aedb4ea23d8c service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:39.677381 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-cf570488-d1ec-4787-90cc-ccb4b7a78c77 req-797df3d0-d6fb-42d7-a884-aedb4ea23d8c service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:39.690721 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-cf570488-d1ec-4787-90cc-ccb4b7a78c77 req-797df3d0-d6fb-42d7-a884-aedb4ea23d8c service nova] Creating event network-changed:ec8710cf-b9f9-4fb9-a83d-176eeaf7d403 for instance b39f037b-6003-425c-bf7d-37a9432efbf7 on hv-cinder-79987 Jul 28 04:07:39.696582 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-cf570488-d1ec-4787-90cc-ccb4b7a78c77 req-797df3d0-d6fb-42d7-a884-aedb4ea23d8c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050975 Jul 28 04:07:39.697502 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 472/886] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:07:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:07:39.745879 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-10bd933a-644f-4b48-926d-7d792b365e5f tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:39.751496 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-10bd933a-644f-4b48-926d-7d792b365e5f tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:39.760322 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-10bd933a-644f-4b48-926d-7d792b365e5f tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:39.761054 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-10bd933a-644f-4b48-926d-7d792b365e5f tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:39.762180 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-10bd933a-644f-4b48-926d-7d792b365e5f tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:39.763103 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-10bd933a-644f-4b48-926d-7d792b365e5f tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:40.146272 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-10bd933a-644f-4b48-926d-7d792b365e5f tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:40.153948 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-10bd933a-644f-4b48-926d-7d792b365e5f tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1358 microversion: 2.1 time: 0.412147 Jul 28 04:07:40.163517 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 415/887] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:39 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1358 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:40.600191 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fb60a417-ff65-4587-aa5f-80c763f1bbb0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:40.601122 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-fb60a417-ff65-4587-aa5f-80c763f1bbb0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:40.607795 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fb60a417-ff65-4587-aa5f-80c763f1bbb0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:40.608293 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fb60a417-ff65-4587-aa5f-80c763f1bbb0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:40.609358 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fb60a417-ff65-4587-aa5f-80c763f1bbb0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:40.609809 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fb60a417-ff65-4587-aa5f-80c763f1bbb0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:40.766748 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-fb60a417-ff65-4587-aa5f-80c763f1bbb0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:40.775401 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-fb60a417-ff65-4587-aa5f-80c763f1bbb0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:40.776946 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-fb60a417-ff65-4587-aa5f-80c763f1bbb0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:40.778175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-fb60a417-ff65-4587-aa5f-80c763f1bbb0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.183269 Jul 28 04:07:40.778738 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 473/888] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:40 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:41.175744 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c7d659e9-a341-4b00-830d-ffad803295f4 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:41.176363 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c7d659e9-a341-4b00-830d-ffad803295f4 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:41.183006 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c7d659e9-a341-4b00-830d-ffad803295f4 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:41.183465 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c7d659e9-a341-4b00-830d-ffad803295f4 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:41.184228 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c7d659e9-a341-4b00-830d-ffad803295f4 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:41.184663 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c7d659e9-a341-4b00-830d-ffad803295f4 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:41.314937 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-c7d659e9-a341-4b00-830d-ffad803295f4 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:41.322510 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-c7d659e9-a341-4b00-830d-ffad803295f4 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1358 microversion: 2.1 time: 0.150646 Jul 28 04:07:41.323118 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 416/889] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:41 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:41.802747 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e7031b88-2956-4344-a1b8-522fbc02bf2e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:41.804132 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e7031b88-2956-4344-a1b8-522fbc02bf2e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:41.812799 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e7031b88-2956-4344-a1b8-522fbc02bf2e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:41.813257 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e7031b88-2956-4344-a1b8-522fbc02bf2e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:41.814079 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e7031b88-2956-4344-a1b8-522fbc02bf2e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:41.814803 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e7031b88-2956-4344-a1b8-522fbc02bf2e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:41.952601 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e7031b88-2956-4344-a1b8-522fbc02bf2e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:41.961102 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e7031b88-2956-4344-a1b8-522fbc02bf2e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:41.962622 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e7031b88-2956-4344-a1b8-522fbc02bf2e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:41.963840 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e7031b88-2956-4344-a1b8-522fbc02bf2e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.165722 Jul 28 04:07:41.964410 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 474/890] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:41 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:42.344183 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-caffafc3-ac12-4c22-a5e4-a63dc30f8b37 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:42.344898 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-caffafc3-ac12-4c22-a5e4-a63dc30f8b37 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:42.350974 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-caffafc3-ac12-4c22-a5e4-a63dc30f8b37 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:42.351431 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-caffafc3-ac12-4c22-a5e4-a63dc30f8b37 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:42.352208 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-caffafc3-ac12-4c22-a5e4-a63dc30f8b37 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:42.352661 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-caffafc3-ac12-4c22-a5e4-a63dc30f8b37 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:42.492375 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-caffafc3-ac12-4c22-a5e4-a63dc30f8b37 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:42.500454 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-caffafc3-ac12-4c22-a5e4-a63dc30f8b37 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1358 microversion: 2.1 time: 0.161136 Jul 28 04:07:42.501031 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 417/891] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:42 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:42.988658 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-03425764-de07-4890-a26e-f26e27a62ac0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:42.989284 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-03425764-de07-4890-a26e-f26e27a62ac0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:42.995804 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-03425764-de07-4890-a26e-f26e27a62ac0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:42.996250 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-03425764-de07-4890-a26e-f26e27a62ac0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:42.997016 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-03425764-de07-4890-a26e-f26e27a62ac0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:42.997453 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-03425764-de07-4890-a26e-f26e27a62ac0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:43.012884 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=100 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:43.134622 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-03425764-de07-4890-a26e-f26e27a62ac0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:43.143685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-03425764-de07-4890-a26e-f26e27a62ac0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:43.145181 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-03425764-de07-4890-a26e-f26e27a62ac0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:43.146329 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-03425764-de07-4890-a26e-f26e27a62ac0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.163216 Jul 28 04:07:43.146910 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 475/892] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:42 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:43.521164 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-23970b24-a8fa-4927-a112-554715271179 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:43.521714 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-23970b24-a8fa-4927-a112-554715271179 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:43.528240 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-23970b24-a8fa-4927-a112-554715271179 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:43.528690 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-23970b24-a8fa-4927-a112-554715271179 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:43.529450 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-23970b24-a8fa-4927-a112-554715271179 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:43.529913 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-23970b24-a8fa-4927-a112-554715271179 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:43.663255 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-23970b24-a8fa-4927-a112-554715271179 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:43.670637 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-23970b24-a8fa-4927-a112-554715271179 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1358 microversion: 2.1 time: 0.153381 Jul 28 04:07:43.671249 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 418/893] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:43 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:44.169456 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4308ada4-e96d-4459-92b0-c713f6954db7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:44.170073 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-4308ada4-e96d-4459-92b0-c713f6954db7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:44.181071 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4308ada4-e96d-4459-92b0-c713f6954db7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:44.181522 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4308ada4-e96d-4459-92b0-c713f6954db7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:44.182283 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4308ada4-e96d-4459-92b0-c713f6954db7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:44.182721 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4308ada4-e96d-4459-92b0-c713f6954db7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:44.314551 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4308ada4-e96d-4459-92b0-c713f6954db7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:44.323041 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4308ada4-e96d-4459-92b0-c713f6954db7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:44.324535 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4308ada4-e96d-4459-92b0-c713f6954db7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:44.325702 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4308ada4-e96d-4459-92b0-c713f6954db7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.160119 Jul 28 04:07:44.326258 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 476/894] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:44 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:44.691380 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-ab8d9543-b1a1-4dcd-8f12-22afb38f2207 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:44.692152 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-ab8d9543-b1a1-4dcd-8f12-22afb38f2207 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:44.699164 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ab8d9543-b1a1-4dcd-8f12-22afb38f2207 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:44.699700 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ab8d9543-b1a1-4dcd-8f12-22afb38f2207 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:44.700574 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ab8d9543-b1a1-4dcd-8f12-22afb38f2207 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:44.701010 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ab8d9543-b1a1-4dcd-8f12-22afb38f2207 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:44.840550 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-ab8d9543-b1a1-4dcd-8f12-22afb38f2207 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:44.848965 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-ab8d9543-b1a1-4dcd-8f12-22afb38f2207 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1358 microversion: 2.1 time: 0.161880 Jul 28 04:07:44.849556 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 419/895] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:44 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:45.349429 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-73512443-2511-46b3-b2f1-56712626bf24 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:45.350153 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-73512443-2511-46b3-b2f1-56712626bf24 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:45.358703 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-73512443-2511-46b3-b2f1-56712626bf24 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:45.359730 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-73512443-2511-46b3-b2f1-56712626bf24 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:45.360454 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-73512443-2511-46b3-b2f1-56712626bf24 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:45.360899 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-73512443-2511-46b3-b2f1-56712626bf24 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:45.502041 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-73512443-2511-46b3-b2f1-56712626bf24 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:45.510995 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-73512443-2511-46b3-b2f1-56712626bf24 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:45.512514 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-73512443-2511-46b3-b2f1-56712626bf24 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:45.513648 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-73512443-2511-46b3-b2f1-56712626bf24 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.168285 Jul 28 04:07:45.514247 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 477/896] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:45 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:45.869264 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-653ae7b2-e0fe-408c-85bb-8c894379401e tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:45.869911 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-653ae7b2-e0fe-408c-85bb-8c894379401e tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:45.877774 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-653ae7b2-e0fe-408c-85bb-8c894379401e tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:45.878221 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-653ae7b2-e0fe-408c-85bb-8c894379401e tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:45.879020 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-653ae7b2-e0fe-408c-85bb-8c894379401e tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:45.879459 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-653ae7b2-e0fe-408c-85bb-8c894379401e tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:46.013651 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-653ae7b2-e0fe-408c-85bb-8c894379401e tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:46.021382 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-653ae7b2-e0fe-408c-85bb-8c894379401e tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1358 microversion: 2.1 time: 0.156056 Jul 28 04:07:46.021950 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 420/897] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:45 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:46.537977 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c43bc72a-a972-49eb-8940-57ae7757c561 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:46.538597 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c43bc72a-a972-49eb-8940-57ae7757c561 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:46.545101 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c43bc72a-a972-49eb-8940-57ae7757c561 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:46.545561 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c43bc72a-a972-49eb-8940-57ae7757c561 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:46.546603 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c43bc72a-a972-49eb-8940-57ae7757c561 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:46.547255 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c43bc72a-a972-49eb-8940-57ae7757c561 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:46.691420 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c43bc72a-a972-49eb-8940-57ae7757c561 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:46.700667 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c43bc72a-a972-49eb-8940-57ae7757c561 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:46.702826 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c43bc72a-a972-49eb-8940-57ae7757c561 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:46.704028 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c43bc72a-a972-49eb-8940-57ae7757c561 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.170533 Jul 28 04:07:46.704597 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 478/898] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:46 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:46.960311 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-1ddce4d7-961d-47a7-8017-5d3a1dc886f6 req-db3abf6a-e3d6-4208-9afd-6be4175480cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "489708ab-f8bf-4f93-aa7a-907559b15d01", "name": "network-vif-plugged", "status": "completed", "tag": "0e9bfde3-9675-4314-9b59-4d7ba4f8ddf3"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:07:46.970975 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-1ddce4d7-961d-47a7-8017-5d3a1dc886f6 req-db3abf6a-e3d6-4208-9afd-6be4175480cd service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:46.971428 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-1ddce4d7-961d-47a7-8017-5d3a1dc886f6 req-db3abf6a-e3d6-4208-9afd-6be4175480cd service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:46.984422 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-1ddce4d7-961d-47a7-8017-5d3a1dc886f6 req-db3abf6a-e3d6-4208-9afd-6be4175480cd service nova] Creating event network-vif-plugged:0e9bfde3-9675-4314-9b59-4d7ba4f8ddf3 for instance 489708ab-f8bf-4f93-aa7a-907559b15d01 on hv-cinder-79987 Jul 28 04:07:46.989509 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-1ddce4d7-961d-47a7-8017-5d3a1dc886f6 req-db3abf6a-e3d6-4208-9afd-6be4175480cd service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032892 Jul 28 04:07:46.990314 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 421/899] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:07:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:07:47.042616 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-8e750d7d-31ff-4992-b19c-da53d19e41bc tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:47.043450 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-8e750d7d-31ff-4992-b19c-da53d19e41bc tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:47.052143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8e750d7d-31ff-4992-b19c-da53d19e41bc tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:47.052143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8e750d7d-31ff-4992-b19c-da53d19e41bc tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:47.052813 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8e750d7d-31ff-4992-b19c-da53d19e41bc tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:47.053316 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-8e750d7d-31ff-4992-b19c-da53d19e41bc tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:47.185130 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-8e750d7d-31ff-4992-b19c-da53d19e41bc tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:47.193265 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-8e750d7d-31ff-4992-b19c-da53d19e41bc tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1358 microversion: 2.1 time: 0.154570 Jul 28 04:07:47.193834 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 479/900] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:47 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:47.728152 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-cd2cfab3-cc08-484d-b907-141f05614d5d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:47.728865 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-cd2cfab3-cc08-484d-b907-141f05614d5d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:47.735837 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-cd2cfab3-cc08-484d-b907-141f05614d5d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:47.736360 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-cd2cfab3-cc08-484d-b907-141f05614d5d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:47.737205 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-cd2cfab3-cc08-484d-b907-141f05614d5d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:47.737712 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-cd2cfab3-cc08-484d-b907-141f05614d5d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:47.883028 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-cd2cfab3-cc08-484d-b907-141f05614d5d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:47.891935 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-cd2cfab3-cc08-484d-b907-141f05614d5d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:47.893442 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-cd2cfab3-cc08-484d-b907-141f05614d5d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:47.897587 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-cd2cfab3-cc08-484d-b907-141f05614d5d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.173662 Jul 28 04:07:47.898178 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 422/901] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:47 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:48.213623 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a173d1e7-d1c3-40cc-a322-b914e154ab95 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:48.214264 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a173d1e7-d1c3-40cc-a322-b914e154ab95 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:48.221607 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a173d1e7-d1c3-40cc-a322-b914e154ab95 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:48.222057 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a173d1e7-d1c3-40cc-a322-b914e154ab95 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:48.222934 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a173d1e7-d1c3-40cc-a322-b914e154ab95 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:48.223379 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a173d1e7-d1c3-40cc-a322-b914e154ab95 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:48.356174 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a173d1e7-d1c3-40cc-a322-b914e154ab95 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:48.364828 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a173d1e7-d1c3-40cc-a322-b914e154ab95 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1358 microversion: 2.1 time: 0.155051 Jul 28 04:07:48.365583 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 480/902] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:48 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:07:48.921551 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a2ce269c-0ecb-40ff-ae34-52153de15c4f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:48.924820 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-a2ce269c-0ecb-40ff-ae34-52153de15c4f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:48.933469 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a2ce269c-0ecb-40ff-ae34-52153de15c4f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:48.933968 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a2ce269c-0ecb-40ff-ae34-52153de15c4f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:48.934692 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a2ce269c-0ecb-40ff-ae34-52153de15c4f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:48.935622 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a2ce269c-0ecb-40ff-ae34-52153de15c4f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:49.028322 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-b4ccd3f5-015f-4302-98b4-2674acc7dcc9 req-69250db3-572a-4a36-b43d-276fb22ce3f4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39f037b-6003-425c-bf7d-37a9432efbf7", "name": "network-vif-plugged", "status": "completed", "tag": "ec8710cf-b9f9-4fb9-a83d-176eeaf7d403"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:07:49.042177 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-b4ccd3f5-015f-4302-98b4-2674acc7dcc9 req-69250db3-572a-4a36-b43d-276fb22ce3f4 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:49.042624 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-b4ccd3f5-015f-4302-98b4-2674acc7dcc9 req-69250db3-572a-4a36-b43d-276fb22ce3f4 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:49.057105 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-b4ccd3f5-015f-4302-98b4-2674acc7dcc9 req-69250db3-572a-4a36-b43d-276fb22ce3f4 service nova] Creating event network-vif-plugged:ec8710cf-b9f9-4fb9-a83d-176eeaf7d403 for instance b39f037b-6003-425c-bf7d-37a9432efbf7 on hv-cinder-79987 Jul 28 04:07:49.068213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-b4ccd3f5-015f-4302-98b4-2674acc7dcc9 req-69250db3-572a-4a36-b43d-276fb22ce3f4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043745 Jul 28 04:07:49.072825 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 481/903] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:07:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:07:49.105132 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-a2ce269c-0ecb-40ff-ae34-52153de15c4f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:49.117939 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-a2ce269c-0ecb-40ff-ae34-52153de15c4f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:49.121157 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-a2ce269c-0ecb-40ff-ae34-52153de15c4f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:49.122945 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-a2ce269c-0ecb-40ff-ae34-52153de15c4f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1809 microversion: 2.20 time: 0.205808 Jul 28 04:07:49.123969 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 423/904] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:48 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1809 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:49.389667 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-83c3adef-14bb-4846-91e3-55452330dfdb tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:49.391341 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-83c3adef-14bb-4846-91e3-55452330dfdb tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:49.397450 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-83c3adef-14bb-4846-91e3-55452330dfdb tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:49.397897 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-83c3adef-14bb-4846-91e3-55452330dfdb tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:49.398657 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-83c3adef-14bb-4846-91e3-55452330dfdb tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:49.399142 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-83c3adef-14bb-4846-91e3-55452330dfdb tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:49.536387 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-83c3adef-14bb-4846-91e3-55452330dfdb tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:49.546090 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-83c3adef-14bb-4846-91e3-55452330dfdb tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1358 microversion: 2.1 time: 0.161268 Jul 28 04:07:49.546765 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 482/905] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:49 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:50.148072 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-ac30751b-99ca-4d2e-ad2e-9a0ae6ffc2e3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:50.148695 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-ac30751b-99ca-4d2e-ad2e-9a0ae6ffc2e3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:50.155777 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ac30751b-99ca-4d2e-ad2e-9a0ae6ffc2e3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:50.156349 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ac30751b-99ca-4d2e-ad2e-9a0ae6ffc2e3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:50.157195 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ac30751b-99ca-4d2e-ad2e-9a0ae6ffc2e3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:50.157695 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ac30751b-99ca-4d2e-ad2e-9a0ae6ffc2e3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:50.303794 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-ac30751b-99ca-4d2e-ad2e-9a0ae6ffc2e3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:50.317613 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-ac30751b-99ca-4d2e-ad2e-9a0ae6ffc2e3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:50.319303 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-ac30751b-99ca-4d2e-ad2e-9a0ae6ffc2e3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:50.320583 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-ac30751b-99ca-4d2e-ad2e-9a0ae6ffc2e3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1796 microversion: 2.20 time: 0.176903 Jul 28 04:07:50.321381 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 424/906] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:07:50 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1796 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:07:50.567951 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ee251305-5ea4-48a2-a3d8-33ca7cca772d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:50.568692 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ee251305-5ea4-48a2-a3d8-33ca7cca772d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:50.571403 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=50 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:07:50.577436 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ee251305-5ea4-48a2-a3d8-33ca7cca772d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:50.577893 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ee251305-5ea4-48a2-a3d8-33ca7cca772d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:50.578674 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ee251305-5ea4-48a2-a3d8-33ca7cca772d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:50.579144 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ee251305-5ea4-48a2-a3d8-33ca7cca772d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:50.712405 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ee251305-5ea4-48a2-a3d8-33ca7cca772d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:50.720023 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ee251305-5ea4-48a2-a3d8-33ca7cca772d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1548 microversion: 2.1 time: 0.156441 Jul 28 04:07:50.720593 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 483/907] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:50 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:50.746375 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-92b513b2-bd74-4021-b1ec-1022dd52a4c0 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:50.747022 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-92b513b2-bd74-4021-b1ec-1022dd52a4c0 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:50.753733 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-92b513b2-bd74-4021-b1ec-1022dd52a4c0 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:50.754187 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-92b513b2-bd74-4021-b1ec-1022dd52a4c0 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:50.755027 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-92b513b2-bd74-4021-b1ec-1022dd52a4c0 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:50.755416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-92b513b2-bd74-4021-b1ec-1022dd52a4c0 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:50.882677 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-92b513b2-bd74-4021-b1ec-1022dd52a4c0 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:50.890061 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-92b513b2-bd74-4021-b1ec-1022dd52a4c0 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1548 microversion: 2.1 time: 0.147586 Jul 28 04:07:50.890628 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 425/908] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:50 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1548 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:50.909285 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a7005f6d-2f42-40ef-8cdf-8ed265e2e671 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:50.914248 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a7005f6d-2f42-40ef-8cdf-8ed265e2e671 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:50.915037 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a7005f6d-2f42-40ef-8cdf-8ed265e2e671 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Searching by: {'deleted': False, 'project_id': '346eb7e46ec54cf087d8b39379cf5129'} {{(pid=118187) get_all /opt/stack/nova/nova/compute/api.py:2965}} Jul 28 04:07:50.922226 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7005f6d-2f42-40ef-8cdf-8ed265e2e671 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:50.922668 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7005f6d-2f42-40ef-8cdf-8ed265e2e671 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:50.923492 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7005f6d-2f42-40ef-8cdf-8ed265e2e671 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:50.923925 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7005f6d-2f42-40ef-8cdf-8ed265e2e671 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:51.013303 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.multi_cell_list [None req-a7005f6d-2f42-40ef-8cdf-8ed265e2e671 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118187) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 28 04:07:51.105642 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a7005f6d-2f42-40ef-8cdf-8ed265e2e671 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.200055 Jul 28 04:07:51.106220 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 484/909] 10.222.0.46 () {58 vars in 1125 bytes} [Thu Jul 28 04:07:50 2022] GET /compute/v2.1/servers => generated 342 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:07:51.117918 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-fce863d3-eb18-4ac1-8d8c-e719e4ef5a5f tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:07:51.118548 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-fce863d3-eb18-4ac1-8d8c-e719e4ef5a5f tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:51.125370 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fce863d3-eb18-4ac1-8d8c-e719e4ef5a5f tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:51.125820 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fce863d3-eb18-4ac1-8d8c-e719e4ef5a5f tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:51.126616 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fce863d3-eb18-4ac1-8d8c-e719e4ef5a5f tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:51.127087 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fce863d3-eb18-4ac1-8d8c-e719e4ef5a5f tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:51.258721 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-fce863d3-eb18-4ac1-8d8c-e719e4ef5a5f tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:07:51.266529 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-fce863d3-eb18-4ac1-8d8c-e719e4ef5a5f tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1548 microversion: 2.1 time: 0.152442 Jul 28 04:07:51.267069 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 426/910] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:07:51 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:07:54.941663 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2c4dbd1d-18ae-4fb0-a4fa-f2febb73b4cc tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a8d8c1e2-7a3e-4802-b5e0-1506bbbf2781"}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:07:54.943946 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-2c4dbd1d-18ae-4fb0-a4fa-f2febb73b4cc tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:07:54.950063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2c4dbd1d-18ae-4fb0-a4fa-f2febb73b4cc tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:54.950513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2c4dbd1d-18ae-4fb0-a4fa-f2febb73b4cc tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:54.951300 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2c4dbd1d-18ae-4fb0-a4fa-f2febb73b4cc tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:07:54.952327 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2c4dbd1d-18ae-4fb0-a4fa-f2febb73b4cc tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:07:55.331798 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-2c4dbd1d-18ae-4fb0-a4fa-f2febb73b4cc tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "POST /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.393852 Jul 28 04:07:55.332549 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 485/911] 10.222.0.46 () {60 vars in 1323 bytes} [Thu Jul 28 04:07:54 2022] POST /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7/os-volume_attachments => generated 194 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:08:01.852792 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-e5f4d71f-b04a-4731-9e58-6e90eb137765 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:01.853416 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-e5f4d71f-b04a-4731-9e58-6e90eb137765 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:01.856587 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=4 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:01.857234 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=83 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:01.862018 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e5f4d71f-b04a-4731-9e58-6e90eb137765 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:01.862474 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e5f4d71f-b04a-4731-9e58-6e90eb137765 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:01.863284 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e5f4d71f-b04a-4731-9e58-6e90eb137765 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:01.863721 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e5f4d71f-b04a-4731-9e58-6e90eb137765 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:01.992471 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-e5f4d71f-b04a-4731-9e58-6e90eb137765 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:02.001033 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-e5f4d71f-b04a-4731-9e58-6e90eb137765 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1594 microversion: 2.1 time: 0.152692 Jul 28 04:08:02.001609 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 427/912] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:01 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1594 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:03.716835 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:03.722260 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-9104c26b-add4-477b-b7a3-32435d122491 req-cc41b0d7-7369-4844-a08c-4a593bd05ad9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b39f037b-6003-425c-bf7d-37a9432efbf7", "tag": "ec8710cf-b9f9-4fb9-a83d-176eeaf7d403"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:03.734846 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-9104c26b-add4-477b-b7a3-32435d122491 req-cc41b0d7-7369-4844-a08c-4a593bd05ad9 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:03.735407 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-9104c26b-add4-477b-b7a3-32435d122491 req-cc41b0d7-7369-4844-a08c-4a593bd05ad9 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:03.746541 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-9104c26b-add4-477b-b7a3-32435d122491 req-cc41b0d7-7369-4844-a08c-4a593bd05ad9 service nova] Creating event network-changed:ec8710cf-b9f9-4fb9-a83d-176eeaf7d403 for instance b39f037b-6003-425c-bf7d-37a9432efbf7 on hv-cinder-79987 Jul 28 04:08:03.752705 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-9104c26b-add4-477b-b7a3-32435d122491 req-cc41b0d7-7369-4844-a08c-4a593bd05ad9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037548 Jul 28 04:08:03.753635 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 486/913] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:08:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:08:04.709378 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-422edc46-858b-49c2-baee-35e8c260ed7c tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-917167549"}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:04.709912 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-422edc46-858b-49c2-baee-35e8c260ed7c tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:04.716494 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-422edc46-858b-49c2-baee-35e8c260ed7c tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:04.719129 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-422edc46-858b-49c2-baee-35e8c260ed7c tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:04.719933 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-422edc46-858b-49c2-baee-35e8c260ed7c tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:04.720375 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-422edc46-858b-49c2-baee-35e8c260ed7c tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:04.853563 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.network.security_group_api [None req-422edc46-858b-49c2-baee-35e8c260ed7c tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Adding security group 26b7b123-710f-4e2a-b942-298b57bfb259 to port ec8710cf-b9f9-4fb9-a83d-176eeaf7d403 Jul 28 04:08:05.199659 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-422edc46-858b-49c2-baee-35e8c260ed7c tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "POST /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7/action" status: 202 len: 0 microversion: 2.1 time: 0.494169 Jul 28 04:08:05.200473 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 428/914] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Jul 28 04:08:04 2022] POST /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7/action => generated 0 bytes in 496 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 28 04:08:05.210374 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3bbc962b-7540-4eb3-b239-616b173f9a99 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:05.211119 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3bbc962b-7540-4eb3-b239-616b173f9a99 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:05.225671 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3bbc962b-7540-4eb3-b239-616b173f9a99 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:05.226122 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3bbc962b-7540-4eb3-b239-616b173f9a99 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:05.226930 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3bbc962b-7540-4eb3-b239-616b173f9a99 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:05.227367 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3bbc962b-7540-4eb3-b239-616b173f9a99 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:05.396679 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3bbc962b-7540-4eb3-b239-616b173f9a99 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:05.405983 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3bbc962b-7540-4eb3-b239-616b173f9a99 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1759 microversion: 2.1 time: 0.200138 Jul 28 04:08:05.406568 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 487/915] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:05 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1759 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:08:05.767942 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-37dfdd54-f28d-42e3-bb17-0f721fd27ef4 req-d5e4855a-5ec0-44b0-bc0f-6857b9730bd1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b39f037b-6003-425c-bf7d-37a9432efbf7", "tag": "ec8710cf-b9f9-4fb9-a83d-176eeaf7d403"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:05.778468 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-37dfdd54-f28d-42e3-bb17-0f721fd27ef4 req-d5e4855a-5ec0-44b0-bc0f-6857b9730bd1 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:05.779035 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-37dfdd54-f28d-42e3-bb17-0f721fd27ef4 req-d5e4855a-5ec0-44b0-bc0f-6857b9730bd1 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:05.791037 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-37dfdd54-f28d-42e3-bb17-0f721fd27ef4 req-d5e4855a-5ec0-44b0-bc0f-6857b9730bd1 service nova] Creating event network-changed:ec8710cf-b9f9-4fb9-a83d-176eeaf7d403 for instance b39f037b-6003-425c-bf7d-37a9432efbf7 on hv-cinder-79987 Jul 28 04:08:05.796543 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-37dfdd54-f28d-42e3-bb17-0f721fd27ef4 req-d5e4855a-5ec0-44b0-bc0f-6857b9730bd1 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032695 Jul 28 04:08:05.797146 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 429/916] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:08:16.982927 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-df97c701-8c9e-48b9-b6ae-39df5fdce86e tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1022320838", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1551827242", "security_groups": [{"name": "tempest-secgroup-smoke-15930751"}], "block_device_mapping_v2": [{"uuid": "bb8d3be6-2e6b-442f-bf6c-9fa7931b53d9", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "1c80a3f8-351e-4afc-86dc-eff91807353a"}]}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:16.992719 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=9 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:16.993359 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:17.099168 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.network.neutron [None req-df97c701-8c9e-48b9-b6ae-39df5fdce86e tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] validate_networks() for [('1c80a3f8-351e-4afc-86dc-eff91807353a', None, None, None, None, None)] {{(pid=118187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:08:17.459299 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-df97c701-8c9e-48b9-b6ae-39df5fdce86e tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Flavor limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:08:17.459725 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-df97c701-8c9e-48b9-b6ae-39df5fdce86e tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Image limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:08:17.460205 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-df97c701-8c9e-48b9-b6ae-39df5fdce86e tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Flavor pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:08:17.460616 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-df97c701-8c9e-48b9-b6ae-39df5fdce86e tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Image pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:08:17.461028 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-df97c701-8c9e-48b9-b6ae-39df5fdce86e tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:08:17.470160 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-df97c701-8c9e-48b9-b6ae-39df5fdce86e tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:17.470618 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-df97c701-8c9e-48b9-b6ae-39df5fdce86e tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:17.471531 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-df97c701-8c9e-48b9-b6ae-39df5fdce86e tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:17.471976 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-df97c701-8c9e-48b9-b6ae-39df5fdce86e tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:17.488561 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-df97c701-8c9e-48b9-b6ae-39df5fdce86e tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Getting quotas for project 338679f381ed4e9e898a59289b0f8178. Resources: {'instances', 'cores', 'ram'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:08:17.492561 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-df97c701-8c9e-48b9-b6ae-39df5fdce86e tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Getting quotas for user 352d60372ba249e38ea4aa2d62723f19 and project 338679f381ed4e9e898a59289b0f8178. Resources: {'instances', 'cores', 'ram'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:08:17.550575 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-df97c701-8c9e-48b9-b6ae-39df5fdce86e tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Going to run 1 instances... {{(pid=118187) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:08:17.553043 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-df97c701-8c9e-48b9-b6ae-39df5fdce86e tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: c4141dc5-3852-4a32-8072-3d64fea68419] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='bb8d3be6-2e6b-442f-bf6c-9fa7931b53d9',volume_size=None,volume_type=None)] {{(pid=118187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:08:17.682985 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-df97c701-8c9e-48b9-b6ae-39df5fdce86e tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.703970 Jul 28 04:08:17.683620 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 488/917] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 04:08:16 2022] POST /compute/v2.1/servers => generated 404 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:08:17.692230 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=6 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:17.692962 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=12 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:17.697217 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-52837049-8acd-4353-a030-ff7b34aa59ec tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:17.698122 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-52837049-8acd-4353-a030-ff7b34aa59ec tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: c4141dc5-3852-4a32-8072-3d64fea68419] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:17.753093 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-52837049-8acd-4353-a030-ff7b34aa59ec tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:17.759923 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-52837049-8acd-4353-a030-ff7b34aa59ec tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419" status: 200 len: 1095 microversion: 2.1 time: 0.069186 Jul 28 04:08:17.763004 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 430/918] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:17 2022] GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419 => generated 1095 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:18.782532 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f8f771fe-3183-4ada-9fbc-9021c6701b10 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:18.783036 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f8f771fe-3183-4ada-9fbc-9021c6701b10 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: c4141dc5-3852-4a32-8072-3d64fea68419] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:18.789753 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f8f771fe-3183-4ada-9fbc-9021c6701b10 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:18.790454 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f8f771fe-3183-4ada-9fbc-9021c6701b10 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:18.791316 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f8f771fe-3183-4ada-9fbc-9021c6701b10 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:18.791844 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f8f771fe-3183-4ada-9fbc-9021c6701b10 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:18.870480 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f8f771fe-3183-4ada-9fbc-9021c6701b10 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:18.880303 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f8f771fe-3183-4ada-9fbc-9021c6701b10 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419" status: 200 len: 1211 microversion: 2.1 time: 0.102929 Jul 28 04:08:18.885579 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 489/919] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:18 2022] GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419 => generated 1211 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:19.901497 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-1e837b8f-aac1-4b45-909f-2fb2d82b4ef4 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:19.902638 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-1e837b8f-aac1-4b45-909f-2fb2d82b4ef4 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: c4141dc5-3852-4a32-8072-3d64fea68419] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:19.911781 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1e837b8f-aac1-4b45-909f-2fb2d82b4ef4 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:19.912621 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1e837b8f-aac1-4b45-909f-2fb2d82b4ef4 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:19.913602 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1e837b8f-aac1-4b45-909f-2fb2d82b4ef4 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:19.914135 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1e837b8f-aac1-4b45-909f-2fb2d82b4ef4 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:20.114156 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-1e837b8f-aac1-4b45-909f-2fb2d82b4ef4 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:20.121667 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-1e837b8f-aac1-4b45-909f-2fb2d82b4ef4 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419" status: 200 len: 1265 microversion: 2.1 time: 0.224081 Jul 28 04:08:20.122239 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 431/920] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:19 2022] GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419 => generated 1265 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:08:20.148655 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-7fc68cf2-dec7-4fb0-a853-c3369551930e req-dacc8967-aad9-4bf7-9b8a-9424907135e9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4141dc5-3852-4a32-8072-3d64fea68419", "tag": "a5e40ccf-c969-45d7-8270-1b6624bac045"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:20.161930 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-7fc68cf2-dec7-4fb0-a853-c3369551930e req-dacc8967-aad9-4bf7-9b8a-9424907135e9 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:20.162376 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-7fc68cf2-dec7-4fb0-a853-c3369551930e req-dacc8967-aad9-4bf7-9b8a-9424907135e9 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:20.174724 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-7fc68cf2-dec7-4fb0-a853-c3369551930e req-dacc8967-aad9-4bf7-9b8a-9424907135e9 service nova] Creating event network-changed:a5e40ccf-c969-45d7-8270-1b6624bac045 for instance c4141dc5-3852-4a32-8072-3d64fea68419 on hv-cinder-79987 Jul 28 04:08:20.179501 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-7fc68cf2-dec7-4fb0-a853-c3369551930e req-dacc8967-aad9-4bf7-9b8a-9424907135e9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034512 Jul 28 04:08:20.180082 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 490/921] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:08:21.142636 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-02e15d93-b77e-483e-bbcf-6686872dde55 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:21.143310 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-02e15d93-b77e-483e-bbcf-6686872dde55 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: c4141dc5-3852-4a32-8072-3d64fea68419] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:21.149801 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-02e15d93-b77e-483e-bbcf-6686872dde55 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:21.150328 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-02e15d93-b77e-483e-bbcf-6686872dde55 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:21.151142 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-02e15d93-b77e-483e-bbcf-6686872dde55 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:21.151575 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-02e15d93-b77e-483e-bbcf-6686872dde55 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:21.355862 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-02e15d93-b77e-483e-bbcf-6686872dde55 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:21.363544 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-02e15d93-b77e-483e-bbcf-6686872dde55 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419" status: 200 len: 1265 microversion: 2.1 time: 0.224856 Jul 28 04:08:21.364127 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 432/922] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:21 2022] GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419 => generated 1265 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:22.385688 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9a35cfb4-e883-408a-a86d-4bbeb62868d5 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:22.386395 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9a35cfb4-e883-408a-a86d-4bbeb62868d5 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: c4141dc5-3852-4a32-8072-3d64fea68419] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:22.393776 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9a35cfb4-e883-408a-a86d-4bbeb62868d5 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:22.394213 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9a35cfb4-e883-408a-a86d-4bbeb62868d5 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:22.395008 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9a35cfb4-e883-408a-a86d-4bbeb62868d5 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:22.395453 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9a35cfb4-e883-408a-a86d-4bbeb62868d5 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:22.535206 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9a35cfb4-e883-408a-a86d-4bbeb62868d5 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:22.543131 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9a35cfb4-e883-408a-a86d-4bbeb62868d5 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419" status: 200 len: 1265 microversion: 2.1 time: 0.162067 Jul 28 04:08:22.543690 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 491/923] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:22 2022] GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:23.564562 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-f8ef7af7-51a7-44e7-8110-a602ad87926f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:23.565208 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-f8ef7af7-51a7-44e7-8110-a602ad87926f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: c4141dc5-3852-4a32-8072-3d64fea68419] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:23.571707 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f8ef7af7-51a7-44e7-8110-a602ad87926f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:23.572164 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f8ef7af7-51a7-44e7-8110-a602ad87926f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:23.572926 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f8ef7af7-51a7-44e7-8110-a602ad87926f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:23.573358 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f8ef7af7-51a7-44e7-8110-a602ad87926f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:23.705243 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-f8ef7af7-51a7-44e7-8110-a602ad87926f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:23.712892 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-f8ef7af7-51a7-44e7-8110-a602ad87926f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419" status: 200 len: 1265 microversion: 2.1 time: 0.152261 Jul 28 04:08:23.713477 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 433/924] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:23 2022] GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:08:24.734123 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-82362487-4ac0-4d69-8cce-e6a558f5068b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:24.734735 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-82362487-4ac0-4d69-8cce-e6a558f5068b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: c4141dc5-3852-4a32-8072-3d64fea68419] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:24.741258 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-82362487-4ac0-4d69-8cce-e6a558f5068b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:24.741706 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-82362487-4ac0-4d69-8cce-e6a558f5068b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:24.742469 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-82362487-4ac0-4d69-8cce-e6a558f5068b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:24.742927 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-82362487-4ac0-4d69-8cce-e6a558f5068b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:24.872080 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-82362487-4ac0-4d69-8cce-e6a558f5068b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:24.880545 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-82362487-4ac0-4d69-8cce-e6a558f5068b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419" status: 200 len: 1265 microversion: 2.1 time: 0.150449 Jul 28 04:08:24.881109 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 492/925] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:24 2022] GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:25.901468 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-742b8306-e6b1-48aa-98a2-670236572a0b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:25.902080 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-742b8306-e6b1-48aa-98a2-670236572a0b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: c4141dc5-3852-4a32-8072-3d64fea68419] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:25.908985 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-742b8306-e6b1-48aa-98a2-670236572a0b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:25.909432 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-742b8306-e6b1-48aa-98a2-670236572a0b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:25.910187 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-742b8306-e6b1-48aa-98a2-670236572a0b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:25.910621 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-742b8306-e6b1-48aa-98a2-670236572a0b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:26.038873 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-742b8306-e6b1-48aa-98a2-670236572a0b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:26.046979 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-742b8306-e6b1-48aa-98a2-670236572a0b tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419" status: 200 len: 1265 microversion: 2.1 time: 0.149397 Jul 28 04:08:26.047541 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 434/926] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:25 2022] GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:27.067694 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-88b4359e-5b6d-4dd6-bc32-5b87dc94c64a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:27.068344 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-88b4359e-5b6d-4dd6-bc32-5b87dc94c64a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: c4141dc5-3852-4a32-8072-3d64fea68419] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:27.074850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-88b4359e-5b6d-4dd6-bc32-5b87dc94c64a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:27.075306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-88b4359e-5b6d-4dd6-bc32-5b87dc94c64a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:27.076072 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-88b4359e-5b6d-4dd6-bc32-5b87dc94c64a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:27.077610 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-88b4359e-5b6d-4dd6-bc32-5b87dc94c64a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:27.204934 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-88b4359e-5b6d-4dd6-bc32-5b87dc94c64a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:27.212429 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-88b4359e-5b6d-4dd6-bc32-5b87dc94c64a tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419" status: 200 len: 1265 microversion: 2.1 time: 0.148545 Jul 28 04:08:27.212938 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 493/927] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:27 2022] GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419 => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:28.233853 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-269bcb46-2b86-4fd3-9133-2793a97940dd tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:28.234445 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-269bcb46-2b86-4fd3-9133-2793a97940dd tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: c4141dc5-3852-4a32-8072-3d64fea68419] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:28.237671 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell0:SELECT=2 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:28.244387 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-269bcb46-2b86-4fd3-9133-2793a97940dd tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:28.244832 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-269bcb46-2b86-4fd3-9133-2793a97940dd tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:28.245624 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-269bcb46-2b86-4fd3-9133-2793a97940dd tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:28.246054 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-269bcb46-2b86-4fd3-9133-2793a97940dd tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:28.396439 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-269bcb46-2b86-4fd3-9133-2793a97940dd tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:28.403919 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-269bcb46-2b86-4fd3-9133-2793a97940dd tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419" status: 200 len: 1265 microversion: 2.1 time: 0.174482 Jul 28 04:08:28.404549 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 435/928] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:28 2022] GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419 => generated 1265 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:29.425194 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f5b85351-745c-40e4-a574-06caf4c4da87 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:29.425811 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f5b85351-745c-40e4-a574-06caf4c4da87 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: c4141dc5-3852-4a32-8072-3d64fea68419] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:29.427932 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:29.428681 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=6 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:29.435126 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f5b85351-745c-40e4-a574-06caf4c4da87 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:29.436128 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f5b85351-745c-40e4-a574-06caf4c4da87 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:29.436924 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f5b85351-745c-40e4-a574-06caf4c4da87 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:29.437386 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f5b85351-745c-40e4-a574-06caf4c4da87 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:29.571558 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f5b85351-745c-40e4-a574-06caf4c4da87 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:29.579929 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f5b85351-745c-40e4-a574-06caf4c4da87 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419" status: 200 len: 1265 microversion: 2.1 time: 0.158624 Jul 28 04:08:29.580494 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 494/929] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:29 2022] GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:29.882323 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-2474c021-3ae6-4227-91af-18ef70471eee tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:29.882884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-2474c021-3ae6-4227-91af-18ef70471eee tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:29.890234 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2474c021-3ae6-4227-91af-18ef70471eee tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:29.890689 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2474c021-3ae6-4227-91af-18ef70471eee tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:29.891482 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2474c021-3ae6-4227-91af-18ef70471eee tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:29.891925 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2474c021-3ae6-4227-91af-18ef70471eee tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:29.920464 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-2474c021-3ae6-4227-91af-18ef70471eee tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01/os-volume_attachments/d60c0f65-6735-4e25-bfc8-00ff4de7cd96" status: 200 len: 194 microversion: 2.20 time: 0.041880 Jul 28 04:08:29.920792 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 436/930] 10.222.0.46 () {60 vars in 1454 bytes} [Thu Jul 28 04:08:29 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01/os-volume_attachments/d60c0f65-6735-4e25-bfc8-00ff4de7cd96 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:08:29.986258 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e1cc47a1-932a-408d-999e-ad4b42b4f65a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:29.986763 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e1cc47a1-932a-408d-999e-ad4b42b4f65a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:29.992789 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e1cc47a1-932a-408d-999e-ad4b42b4f65a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:29.993252 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e1cc47a1-932a-408d-999e-ad4b42b4f65a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:29.994017 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e1cc47a1-932a-408d-999e-ad4b42b4f65a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:29.994460 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e1cc47a1-932a-408d-999e-ad4b42b4f65a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:30.073503 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.objects.instance [None req-e1cc47a1-932a-408d-999e-ad4b42b4f65a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lazy-loading 'services' on Instance uuid 489708ab-f8bf-4f93-aa7a-907559b15d01 {{(pid=118187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:08:30.144664 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e1cc47a1-932a-408d-999e-ad4b42b4f65a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "DELETE /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01/os-volume_attachments/d60c0f65-6735-4e25-bfc8-00ff4de7cd96" status: 202 len: 0 microversion: 2.20 time: 0.162384 Jul 28 04:08:30.145189 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 495/931] 10.222.0.46 () {60 vars in 1457 bytes} [Thu Jul 28 04:08:29 2022] DELETE /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01/os-volume_attachments/d60c0f65-6735-4e25-bfc8-00ff4de7cd96 => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:08:30.153942 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-7d8174be-74eb-40da-adee-d7b98a0849e6 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:30.156432 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-7d8174be-74eb-40da-adee-d7b98a0849e6 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:30.163046 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7d8174be-74eb-40da-adee-d7b98a0849e6 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:30.163496 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7d8174be-74eb-40da-adee-d7b98a0849e6 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:30.164257 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7d8174be-74eb-40da-adee-d7b98a0849e6 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:30.164683 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-7d8174be-74eb-40da-adee-d7b98a0849e6 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:30.197739 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-7d8174be-74eb-40da-adee-d7b98a0849e6 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047852 Jul 28 04:08:30.198309 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 437/932] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Jul 28 04:08:30 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:08:30.602129 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9bd2d819-e81b-47cd-8f2a-770b9b45ae8d tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:30.602897 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9bd2d819-e81b-47cd-8f2a-770b9b45ae8d tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: c4141dc5-3852-4a32-8072-3d64fea68419] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:30.610413 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9bd2d819-e81b-47cd-8f2a-770b9b45ae8d tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:30.610902 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9bd2d819-e81b-47cd-8f2a-770b9b45ae8d tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:30.611686 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9bd2d819-e81b-47cd-8f2a-770b9b45ae8d tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:30.612138 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9bd2d819-e81b-47cd-8f2a-770b9b45ae8d tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:30.746637 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9bd2d819-e81b-47cd-8f2a-770b9b45ae8d tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:30.755064 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9bd2d819-e81b-47cd-8f2a-770b9b45ae8d tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419" status: 200 len: 1265 microversion: 2.1 time: 0.157249 Jul 28 04:08:30.755628 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 496/933] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:30 2022] GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:31.026395 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-9211fb08-d133-4bb4-a554-51f7f128f2ad req-cd9f4570-5403-47b1-b406-3c48d79f50d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4141dc5-3852-4a32-8072-3d64fea68419", "name": "network-vif-plugged", "status": "completed", "tag": "a5e40ccf-c969-45d7-8270-1b6624bac045"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:31.037062 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-9211fb08-d133-4bb4-a554-51f7f128f2ad req-cd9f4570-5403-47b1-b406-3c48d79f50d9 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:31.037752 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-9211fb08-d133-4bb4-a554-51f7f128f2ad req-cd9f4570-5403-47b1-b406-3c48d79f50d9 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:31.050194 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-9211fb08-d133-4bb4-a554-51f7f128f2ad req-cd9f4570-5403-47b1-b406-3c48d79f50d9 service nova] Creating event network-vif-plugged:a5e40ccf-c969-45d7-8270-1b6624bac045 for instance c4141dc5-3852-4a32-8072-3d64fea68419 on hv-cinder-79987 Jul 28 04:08:31.055225 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-9211fb08-d133-4bb4-a554-51f7f128f2ad req-cd9f4570-5403-47b1-b406-3c48d79f50d9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032480 Jul 28 04:08:31.055818 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 438/934] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:08:31.066396 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-07c533e7-5876-4553-9a67-8136017d9ca6 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:31.068664 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-07c533e7-5876-4553-9a67-8136017d9ca6 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:31.074962 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-07c533e7-5876-4553-9a67-8136017d9ca6 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:31.075541 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-07c533e7-5876-4553-9a67-8136017d9ca6 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:31.076268 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-07c533e7-5876-4553-9a67-8136017d9ca6 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:31.076718 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-07c533e7-5876-4553-9a67-8136017d9ca6 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:31.149071 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-07c533e7-5876-4553-9a67-8136017d9ca6 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "POST /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7/action" status: 202 len: 0 microversion: 2.1 time: 0.086534 Jul 28 04:08:31.149584 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 497/935] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Jul 28 04:08:31 2022] POST /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:08:31.159464 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-efde26cb-a829-4427-b06d-2a6e21528631 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:31.160263 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-efde26cb-a829-4427-b06d-2a6e21528631 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:31.167372 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-efde26cb-a829-4427-b06d-2a6e21528631 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:31.167933 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-efde26cb-a829-4427-b06d-2a6e21528631 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:31.168912 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-efde26cb-a829-4427-b06d-2a6e21528631 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:31.169665 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-efde26cb-a829-4427-b06d-2a6e21528631 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:31.212056 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-69e7e1a5-c6ae-4810-a964-f52b58671f35 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:31.215148 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-69e7e1a5-c6ae-4810-a964-f52b58671f35 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:31.224157 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-69e7e1a5-c6ae-4810-a964-f52b58671f35 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:31.224696 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-69e7e1a5-c6ae-4810-a964-f52b58671f35 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:31.225497 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-69e7e1a5-c6ae-4810-a964-f52b58671f35 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:31.226135 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-69e7e1a5-c6ae-4810-a964-f52b58671f35 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:31.262564 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-69e7e1a5-c6ae-4810-a964-f52b58671f35 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.054890 Jul 28 04:08:31.263061 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 498/936] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Jul 28 04:08:31 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01/os-volume_attachments => generated 25 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:31.329610 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6cef7f6c-76df-4e69-ad6f-6ba1c45e1997 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:31.330611 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6cef7f6c-76df-4e69-ad6f-6ba1c45e1997 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:31.337272 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6cef7f6c-76df-4e69-ad6f-6ba1c45e1997 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:31.337856 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6cef7f6c-76df-4e69-ad6f-6ba1c45e1997 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:31.338666 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6cef7f6c-76df-4e69-ad6f-6ba1c45e1997 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:31.339128 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6cef7f6c-76df-4e69-ad6f-6ba1c45e1997 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:31.365828 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6cef7f6c-76df-4e69-ad6f-6ba1c45e1997 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Going to try to terminate instance {{(pid=118187) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:08:31.446352 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6cef7f6c-76df-4e69-ad6f-6ba1c45e1997 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "DELETE /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 204 len: 0 microversion: 2.20 time: 0.121261 Jul 28 04:08:31.447376 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 499/937] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 04:08:31 2022] DELETE /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 28 04:08:31.456190 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5c3a828a-55d7-4d28-8007-b25f75760d5b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:31.457531 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5c3a828a-55d7-4d28-8007-b25f75760d5b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:31.463651 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5c3a828a-55d7-4d28-8007-b25f75760d5b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:31.464105 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5c3a828a-55d7-4d28-8007-b25f75760d5b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:31.464881 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5c3a828a-55d7-4d28-8007-b25f75760d5b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:31.465323 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5c3a828a-55d7-4d28-8007-b25f75760d5b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:31.494283 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-efde26cb-a829-4427-b06d-2a6e21528631 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:31.505349 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-efde26cb-a829-4427-b06d-2a6e21528631 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1751 microversion: 2.1 time: 0.351226 Jul 28 04:08:31.506191 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 439/938] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:31 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1751 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:31.602152 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5c3a828a-55d7-4d28-8007-b25f75760d5b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:31.610772 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5c3a828a-55d7-4d28-8007-b25f75760d5b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:31.612310 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5c3a828a-55d7-4d28-8007-b25f75760d5b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:31.613516 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5c3a828a-55d7-4d28-8007-b25f75760d5b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1724 microversion: 2.20 time: 0.162024 Jul 28 04:08:31.614071 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 500/939] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:08:31 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:08:31.775634 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-e228a285-2a0e-4a8e-974e-d4134af239ff tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:31.776168 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-e228a285-2a0e-4a8e-974e-d4134af239ff tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: c4141dc5-3852-4a32-8072-3d64fea68419] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:31.782946 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e228a285-2a0e-4a8e-974e-d4134af239ff tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:31.783392 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e228a285-2a0e-4a8e-974e-d4134af239ff tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:31.784145 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e228a285-2a0e-4a8e-974e-d4134af239ff tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:31.784573 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e228a285-2a0e-4a8e-974e-d4134af239ff tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:31.919721 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-e228a285-2a0e-4a8e-974e-d4134af239ff tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:31.927259 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-e228a285-2a0e-4a8e-974e-d4134af239ff tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419" status: 200 len: 1265 microversion: 2.1 time: 0.155447 Jul 28 04:08:31.927828 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 440/940] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:31 2022] GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:32.527052 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d14bd072-a1a6-421d-a94e-794d0fafacd6 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:32.527694 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d14bd072-a1a6-421d-a94e-794d0fafacd6 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:32.534866 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d14bd072-a1a6-421d-a94e-794d0fafacd6 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:32.535325 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d14bd072-a1a6-421d-a94e-794d0fafacd6 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:32.536361 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d14bd072-a1a6-421d-a94e-794d0fafacd6 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:32.536799 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d14bd072-a1a6-421d-a94e-794d0fafacd6 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:32.637175 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-12d3540c-90d7-4280-aa61-78a002f3a3b0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:32.637796 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-12d3540c-90d7-4280-aa61-78a002f3a3b0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:32.645024 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-12d3540c-90d7-4280-aa61-78a002f3a3b0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:32.645469 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-12d3540c-90d7-4280-aa61-78a002f3a3b0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:32.646224 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-12d3540c-90d7-4280-aa61-78a002f3a3b0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:32.646655 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-12d3540c-90d7-4280-aa61-78a002f3a3b0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:32.678290 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d14bd072-a1a6-421d-a94e-794d0fafacd6 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:32.686743 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d14bd072-a1a6-421d-a94e-794d0fafacd6 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1751 microversion: 2.1 time: 0.163419 Jul 28 04:08:32.687380 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 501/941] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:32 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:32.775855 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-12d3540c-90d7-4280-aa61-78a002f3a3b0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:32.784061 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-12d3540c-90d7-4280-aa61-78a002f3a3b0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:32.785509 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-12d3540c-90d7-4280-aa61-78a002f3a3b0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:32.786955 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-12d3540c-90d7-4280-aa61-78a002f3a3b0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1724 microversion: 2.20 time: 0.153788 Jul 28 04:08:32.787518 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 441/942] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:08:32 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:08:32.947899 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-71ff4f21-8e3e-420a-9bf4-4eed513bd153 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:32.948549 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-71ff4f21-8e3e-420a-9bf4-4eed513bd153 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: c4141dc5-3852-4a32-8072-3d64fea68419] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:32.954868 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-71ff4f21-8e3e-420a-9bf4-4eed513bd153 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:32.955329 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-71ff4f21-8e3e-420a-9bf4-4eed513bd153 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:32.956096 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-71ff4f21-8e3e-420a-9bf4-4eed513bd153 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:32.956537 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-71ff4f21-8e3e-420a-9bf4-4eed513bd153 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:32.975405 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=95,nova_cell1:INSERT=3,nova_cell1:UPDATE=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:33.091361 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-71ff4f21-8e3e-420a-9bf4-4eed513bd153 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:33.099513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-71ff4f21-8e3e-420a-9bf4-4eed513bd153 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419" status: 200 len: 1265 microversion: 2.1 time: 0.155507 Jul 28 04:08:33.100088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 502/943] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:32 2022] GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:33.707845 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-92d5db8e-15fb-42cb-9cb9-acff931aa3b6 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:33.708611 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-92d5db8e-15fb-42cb-9cb9-acff931aa3b6 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:33.716203 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-92d5db8e-15fb-42cb-9cb9-acff931aa3b6 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:33.716650 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-92d5db8e-15fb-42cb-9cb9-acff931aa3b6 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:33.718587 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-92d5db8e-15fb-42cb-9cb9-acff931aa3b6 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:33.719403 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-92d5db8e-15fb-42cb-9cb9-acff931aa3b6 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:33.810990 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-121de942-f4b8-469f-87ab-fb1dea22a1dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:33.811645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-121de942-f4b8-469f-87ab-fb1dea22a1dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:33.818087 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-121de942-f4b8-469f-87ab-fb1dea22a1dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:33.818542 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-121de942-f4b8-469f-87ab-fb1dea22a1dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:33.819350 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-121de942-f4b8-469f-87ab-fb1dea22a1dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:33.819790 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-121de942-f4b8-469f-87ab-fb1dea22a1dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:33.949464 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-121de942-f4b8-469f-87ab-fb1dea22a1dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:33.957543 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-121de942-f4b8-469f-87ab-fb1dea22a1dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:33.959081 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-121de942-f4b8-469f-87ab-fb1dea22a1dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:33.960285 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-121de942-f4b8-469f-87ab-fb1dea22a1dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1724 microversion: 2.20 time: 0.153363 Jul 28 04:08:33.961086 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 503/944] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:08:33 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:08:33.988503 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-92d5db8e-15fb-42cb-9cb9-acff931aa3b6 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:33.996322 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-92d5db8e-15fb-42cb-9cb9-acff931aa3b6 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1751 microversion: 2.1 time: 0.292551 Jul 28 04:08:33.996893 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 442/945] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:33 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1751 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:34.119823 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-37c0b565-ee1b-4bb1-8e1d-f463bbc92ace tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:34.120456 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-37c0b565-ee1b-4bb1-8e1d-f463bbc92ace tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: c4141dc5-3852-4a32-8072-3d64fea68419] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:34.127109 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-37c0b565-ee1b-4bb1-8e1d-f463bbc92ace tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:34.127560 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-37c0b565-ee1b-4bb1-8e1d-f463bbc92ace tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:34.128329 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-37c0b565-ee1b-4bb1-8e1d-f463bbc92ace tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:34.128766 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-37c0b565-ee1b-4bb1-8e1d-f463bbc92ace tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:34.263466 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-37c0b565-ee1b-4bb1-8e1d-f463bbc92ace tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:34.280074 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-37c0b565-ee1b-4bb1-8e1d-f463bbc92ace tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419" status: 200 len: 1265 microversion: 2.1 time: 0.164084 Jul 28 04:08:34.280977 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 504/946] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:34 2022] GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:34.932258 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-4dd3bda9-165d-4b45-b0db-60042160a1f5 req-78045e16-a60e-4b59-ab9b-246aa02ed1ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "489708ab-f8bf-4f93-aa7a-907559b15d01", "name": "network-vif-deleted", "tag": "0e9bfde3-9675-4314-9b59-4d7ba4f8ddf3"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:34.943248 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-4dd3bda9-165d-4b45-b0db-60042160a1f5 req-78045e16-a60e-4b59-ab9b-246aa02ed1ff service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:34.943682 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-4dd3bda9-165d-4b45-b0db-60042160a1f5 req-78045e16-a60e-4b59-ab9b-246aa02ed1ff service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:34.955936 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-4dd3bda9-165d-4b45-b0db-60042160a1f5 req-78045e16-a60e-4b59-ab9b-246aa02ed1ff service nova] Creating event network-vif-deleted:0e9bfde3-9675-4314-9b59-4d7ba4f8ddf3 for instance 489708ab-f8bf-4f93-aa7a-907559b15d01 on hv-cinder-79987 Jul 28 04:08:34.961151 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-4dd3bda9-165d-4b45-b0db-60042160a1f5 req-78045e16-a60e-4b59-ab9b-246aa02ed1ff service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032539 Jul 28 04:08:34.961886 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 443/947] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:08:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:08:34.986932 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b278c673-f600-4491-b2d6-b32db221cf3d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:34.987730 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b278c673-f600-4491-b2d6-b32db221cf3d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:34.994958 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b278c673-f600-4491-b2d6-b32db221cf3d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:34.995542 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b278c673-f600-4491-b2d6-b32db221cf3d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:34.996416 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b278c673-f600-4491-b2d6-b32db221cf3d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:34.996951 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b278c673-f600-4491-b2d6-b32db221cf3d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:35.021001 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-f6d0017f-b5af-4bf9-8bb8-b9c80fc7bca1 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:35.021864 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-f6d0017f-b5af-4bf9-8bb8-b9c80fc7bca1 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:35.029065 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f6d0017f-b5af-4bf9-8bb8-b9c80fc7bca1 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:35.029631 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f6d0017f-b5af-4bf9-8bb8-b9c80fc7bca1 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:35.030446 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f6d0017f-b5af-4bf9-8bb8-b9c80fc7bca1 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:35.030905 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f6d0017f-b5af-4bf9-8bb8-b9c80fc7bca1 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:35.081104 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b278c673-f600-4491-b2d6-b32db221cf3d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:35.090252 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b278c673-f600-4491-b2d6-b32db221cf3d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:35.092753 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b278c673-f600-4491-b2d6-b32db221cf3d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:35.094360 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b278c673-f600-4491-b2d6-b32db221cf3d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 200 len: 1367 microversion: 2.20 time: 0.114412 Jul 28 04:08:35.095172 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 505/948] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:08:34 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 1367 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:08:35.203132 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-f6d0017f-b5af-4bf9-8bb8-b9c80fc7bca1 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:35.211552 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-f6d0017f-b5af-4bf9-8bb8-b9c80fc7bca1 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1756 microversion: 2.1 time: 0.194805 Jul 28 04:08:35.212121 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 444/949] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:35 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1756 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:35.302653 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b500de67-0b47-4138-a16c-2809ab963526 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:35.303391 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b500de67-0b47-4138-a16c-2809ab963526 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: c4141dc5-3852-4a32-8072-3d64fea68419] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:35.309444 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b500de67-0b47-4138-a16c-2809ab963526 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:35.309893 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b500de67-0b47-4138-a16c-2809ab963526 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:35.310718 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b500de67-0b47-4138-a16c-2809ab963526 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:35.311302 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b500de67-0b47-4138-a16c-2809ab963526 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:35.449395 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b500de67-0b47-4138-a16c-2809ab963526 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:35.458686 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b500de67-0b47-4138-a16c-2809ab963526 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419" status: 200 len: 1453 microversion: 2.1 time: 0.160174 Jul 28 04:08:35.459311 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 506/950] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:35 2022] GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:35.479260 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-450312fd-617f-4a15-bc5c-50e6b570108c tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:35.479874 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-450312fd-617f-4a15-bc5c-50e6b570108c tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: c4141dc5-3852-4a32-8072-3d64fea68419] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:35.486698 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-450312fd-617f-4a15-bc5c-50e6b570108c tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:35.487178 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-450312fd-617f-4a15-bc5c-50e6b570108c tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:35.487971 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-450312fd-617f-4a15-bc5c-50e6b570108c tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:35.488403 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-450312fd-617f-4a15-bc5c-50e6b570108c tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:35.627994 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-450312fd-617f-4a15-bc5c-50e6b570108c tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:35.635497 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-450312fd-617f-4a15-bc5c-50e6b570108c tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419" status: 200 len: 1453 microversion: 2.1 time: 0.160222 Jul 28 04:08:35.636066 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 445/951] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:35 2022] GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419 => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:36.117717 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b82da407-bb65-4bf3-bb3b-240ce79cf75a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:36.118331 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b82da407-bb65-4bf3-bb3b-240ce79cf75a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:36.125831 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b82da407-bb65-4bf3-bb3b-240ce79cf75a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:36.126279 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b82da407-bb65-4bf3-bb3b-240ce79cf75a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:36.127080 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b82da407-bb65-4bf3-bb3b-240ce79cf75a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:36.127521 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b82da407-bb65-4bf3-bb3b-240ce79cf75a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:36.142752 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-b82da407-bb65-4bf3-bb3b-240ce79cf75a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] HTTP exception thrown: Instance 489708ab-f8bf-4f93-aa7a-907559b15d01 could not be found. Jul 28 04:08:36.144461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b82da407-bb65-4bf3-bb3b-240ce79cf75a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Request method failure captured: Jul 28 04:08:36.144461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 HTTP/1.1 Jul 28 04:08:36.144461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:08:36.144461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:08:36.144461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:08:36.144461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:08:36.144461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:08:36.144461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:08:36.144461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:08:36.144461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:08:36.144461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gsSLBIwCkjWGVWiAAxQvkoAA-Lh2Nrbf3kSC5qt-AIzx6GfsSO3Jm8efkjl_jg_m8-CRu8Fl4S1VS8YpdGrqXn9HRBd8Y7Rowxp-kC9D5fLXpu1YoUub4I9ivGNakN7WAfSAWUdiEGoP3cCrehvGHlIoPYxC0xFon84y82UgiXpODw Jul 28 04:08:36.144461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:08:36.144461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:08:36.144461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:08:36.144461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:08:36.144461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 04:08:36.144461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:08:36.144461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:08:36.144461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 901cf93dff224196b6727a29f0038bdb Jul 28 04:08:36.144461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1608463631 Jul 28 04:08:36.144461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:08:36.144461 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:08:36.146180 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_901cf93dff224196b6727a29f0038bdb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/901cf93dff224196b6727a29f0038bdb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/901cf93dff224196b6727a29f0038bdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/901cf93dff224196b6727a29f0038bdb"}]}] Jul 28 04:08:36.146180 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1608463631 Jul 28 04:08:36.146180 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 901cf93dff224196b6727a29f0038bdb Jul 28 04:08:36.146180 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1608463631 Jul 28 04:08:36.146180 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeShelveTestJSON-1608463631-project Jul 28 04:08:36.146180 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:08:36.146180 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:08:36.146180 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: b7e6ceb0f76d41ce962efd065ffa3d5a Jul 28 04:08:36.146180 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1608463631-project Jul 28 04:08:36.146180 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:08:36.146180 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Instance 489708ab-f8bf-4f93-aa7a-907559b15d01 could not be found. Jul 28 04:08:36.146180 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': '489708ab-f8bf-4f93-aa7a-907559b15d01'} Jul 28 04:08:36.147068 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:08:36.147068 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:08:36.147068 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:08:36.147068 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:08:36.147068 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:08:36.147068 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:08:36.147068 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:08:36.147068 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:08:36.147068 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:08:36.147068 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:08:36.147068 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 489708ab-f8bf-4f93-aa7a-907559b15d01 could not be found. Jul 28 04:08:36.147068 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:08:36.147068 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:08:36.147068 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:08:36.147068 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:08:36.147068 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:08:36.147068 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:08:36.147068 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:08:36.147068 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:08:36.147068 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:08:36.148380 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:08:36.148380 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:08:36.148380 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:08:36.148380 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:08:36.148380 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:08:36.148380 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:08:36.148380 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:08:36.148380 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 489708ab-f8bf-4f93-aa7a-907559b15d01 could not be found. Jul 28 04:08:36.148380 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:08:36.148380 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:08:36.148380 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:08:36.148380 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:08:36.148380 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:08:36.148380 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:08:36.148380 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:08:36.148380 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:08:36.148380 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 489708ab-f8bf-4f93-aa7a-907559b15d01 could not be found. Jul 28 04:08:36.148380 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:08:36.149559 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b82da407-bb65-4bf3-bb3b-240ce79cf75a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Returning 404 to user: Instance 489708ab-f8bf-4f93-aa7a-907559b15d01 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:08:36.149559 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b82da407-bb65-4bf3-bb3b-240ce79cf75a tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 404 len: 111 microversion: 2.20 time: 0.032194 Jul 28 04:08:36.149559 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 507/952] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:08:36 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 04:08:36.156002 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-9ebdbeb7-468d-41e5-859e-93d1564e9c96 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '.version_select at 0x7fa6ee09f8b0>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:36.181698 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-9ebdbeb7-468d-41e5-859e-93d1564e9c96 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1253939240" status: 204 len: 0 microversion: 2.20 time: 0.030358 Jul 28 04:08:36.182356 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 446/953] 10.222.0.46 () {60 vars in 1262 bytes} [Thu Jul 28 04:08:36 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1253939240 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 04:08:36.235382 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-f2eb4c4b-3430-474b-abcc-dd501743cdce tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:36.236199 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-f2eb4c4b-3430-474b-abcc-dd501743cdce tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:36.242898 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f2eb4c4b-3430-474b-abcc-dd501743cdce tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:36.243351 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f2eb4c4b-3430-474b-abcc-dd501743cdce tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:36.244353 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f2eb4c4b-3430-474b-abcc-dd501743cdce tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:36.244792 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-f2eb4c4b-3430-474b-abcc-dd501743cdce tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:36.596255 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-f2eb4c4b-3430-474b-abcc-dd501743cdce tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:36.604504 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-f2eb4c4b-3430-474b-abcc-dd501743cdce tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1756 microversion: 2.1 time: 0.374489 Jul 28 04:08:36.605264 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 508/954] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:36 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1756 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:36.866752 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-50d45247-0f6b-47dc-8835-a7e331ffbb5d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Action: 'create', calling method: .version_select at 0x7fa6ee01baf0>, body: {"keypair": {"name": "tempest-keypair-1102715826", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCk9/esGBScHZinN5l5yCEfcb5DEnEF8NgiW1eXIbef11cXyerz/YrnYS3/en6WRlgkPa5hwd2ApCX/+c+Uci5/P9Yx7tjbTZ/RzAV/bMg8Fc+7B9I4XPtOHnMKQJ4lSJQ=="}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:36.883788 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-50d45247-0f6b-47dc-8835-a7e331ffbb5d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Getting quotas for project 901cf93dff224196b6727a29f0038bdb. Resources: {'key_pairs'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:08:36.889431 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-50d45247-0f6b-47dc-8835-a7e331ffbb5d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Getting quotas for user b7e6ceb0f76d41ce962efd065ffa3d5a and project 901cf93dff224196b6727a29f0038bdb. Resources: {'key_pairs'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:08:36.917006 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-50d45247-0f6b-47dc-8835-a7e331ffbb5d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.054076 Jul 28 04:08:36.917627 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 447/955] 10.222.0.46 () {62 vars in 1200 bytes} [Thu Jul 28 04:08:36 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 55 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 28 04:08:37.627337 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-38b06ca6-9875-4797-b7ab-591ea65875f9 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:37.628022 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-38b06ca6-9875-4797-b7ab-591ea65875f9 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:37.634688 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-38b06ca6-9875-4797-b7ab-591ea65875f9 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:37.635456 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-38b06ca6-9875-4797-b7ab-591ea65875f9 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:37.636349 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-38b06ca6-9875-4797-b7ab-591ea65875f9 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:37.636942 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-38b06ca6-9875-4797-b7ab-591ea65875f9 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:37.788134 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-b26f40ec-a880-43e0-9682-16e2473633ac req-4974bd86-fe03-4c65-abee-94282998076d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4141dc5-3852-4a32-8072-3d64fea68419", "tag": "a5e40ccf-c969-45d7-8270-1b6624bac045"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:37.798929 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-b26f40ec-a880-43e0-9682-16e2473633ac req-4974bd86-fe03-4c65-abee-94282998076d service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:37.799557 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-b26f40ec-a880-43e0-9682-16e2473633ac req-4974bd86-fe03-4c65-abee-94282998076d service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:37.812056 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-b26f40ec-a880-43e0-9682-16e2473633ac req-4974bd86-fe03-4c65-abee-94282998076d service nova] Creating event network-changed:a5e40ccf-c969-45d7-8270-1b6624bac045 for instance c4141dc5-3852-4a32-8072-3d64fea68419 on hv-cinder-79987 Jul 28 04:08:37.817125 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-b26f40ec-a880-43e0-9682-16e2473633ac req-4974bd86-fe03-4c65-abee-94282998076d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.219691 Jul 28 04:08:37.817728 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 509/956] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:08:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:08:37.901083 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-38b06ca6-9875-4797-b7ab-591ea65875f9 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:37.910761 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-38b06ca6-9875-4797-b7ab-591ea65875f9 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1756 microversion: 2.1 time: 0.288817 Jul 28 04:08:37.916868 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 448/957] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:37 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1756 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:08:38.741719 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-aa54ca5f-27db-456c-a62a-de6a2fb0a5f0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1474453185", "imageRef": "a0eec51c-83e9-420b-bcb9-20fe8dcf5321", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24a1a4ba-e12a-48fd-9c17-f0ddc850f27d"}], "security_groups": [{"name": "tempest-securitygroup--418345049"}], "key_name": "tempest-keypair-1102715826", "user_data": "}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:38.876161 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.network.neutron [None req-aa54ca5f-27db-456c-a62a-de6a2fb0a5f0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] validate_networks() for [('24a1a4ba-e12a-48fd-9c17-f0ddc850f27d', None, None, None, None, None)] {{(pid=118187) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:08:38.933533 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-6e4dfd65-6cc8-4cdb-aa07-0a3be56bc022 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:38.934223 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-6e4dfd65-6cc8-4cdb-aa07-0a3be56bc022 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:38.941789 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6e4dfd65-6cc8-4cdb-aa07-0a3be56bc022 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:38.942239 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6e4dfd65-6cc8-4cdb-aa07-0a3be56bc022 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:38.943058 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6e4dfd65-6cc8-4cdb-aa07-0a3be56bc022 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:38.943494 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6e4dfd65-6cc8-4cdb-aa07-0a3be56bc022 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:39.182145 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-6e4dfd65-6cc8-4cdb-aa07-0a3be56bc022 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:39.191004 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-6e4dfd65-6cc8-4cdb-aa07-0a3be56bc022 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1756 microversion: 2.1 time: 0.261353 Jul 28 04:08:39.191596 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 449/958] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:38 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1756 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:08:39.276336 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-aa54ca5f-27db-456c-a62a-de6a2fb0a5f0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Flavor limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:08:39.276837 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-aa54ca5f-27db-456c-a62a-de6a2fb0a5f0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Image limits 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:08:39.277448 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-aa54ca5f-27db-456c-a62a-de6a2fb0a5f0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Flavor pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:08:39.277926 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-aa54ca5f-27db-456c-a62a-de6a2fb0a5f0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Image pref 0:0:0 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:08:39.278490 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.virt.hardware [None req-aa54ca5f-27db-456c-a62a-de6a2fb0a5f0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118187) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:08:39.289402 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aa54ca5f-27db-456c-a62a-de6a2fb0a5f0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:39.289572 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aa54ca5f-27db-456c-a62a-de6a2fb0a5f0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:39.290299 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aa54ca5f-27db-456c-a62a-de6a2fb0a5f0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:39.290741 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aa54ca5f-27db-456c-a62a-de6a2fb0a5f0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:39.308250 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-aa54ca5f-27db-456c-a62a-de6a2fb0a5f0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Getting quotas for project 901cf93dff224196b6727a29f0038bdb. Resources: {'instances', 'cores', 'ram'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:08:39.312896 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-aa54ca5f-27db-456c-a62a-de6a2fb0a5f0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Getting quotas for user b7e6ceb0f76d41ce962efd065ffa3d5a and project 901cf93dff224196b6727a29f0038bdb. Resources: {'instances', 'cores', 'ram'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:08:39.323731 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-aa54ca5f-27db-456c-a62a-de6a2fb0a5f0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Going to run 1 instances... {{(pid=118187) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:08:39.326644 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-aa54ca5f-27db-456c-a62a-de6a2fb0a5f0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a0eec51c-83e9-420b-bcb9-20fe8dcf5321',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118187) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:08:39.375921 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-aa54ca5f-27db-456c-a62a-de6a2fb0a5f0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.639257 Jul 28 04:08:39.376804 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 510/959] 10.222.0.46 () {62 vars in 1188 bytes} [Thu Jul 28 04:08:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 28 04:08:39.387248 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-4f91a2f7-8077-46fc-9560-093d9265b996 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:39.388127 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-4f91a2f7-8077-46fc-9560-093d9265b996 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:39.447680 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-4f91a2f7-8077-46fc-9560-093d9265b996 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:39.456170 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-4f91a2f7-8077-46fc-9560-093d9265b996 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:39.458038 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-4f91a2f7-8077-46fc-9560-093d9265b996 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:39.459307 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-4f91a2f7-8077-46fc-9560-093d9265b996 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1282 microversion: 2.20 time: 0.075848 Jul 28 04:08:39.459973 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 450/960] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:08:39 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1282 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:08:40.213566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5521026c-7b91-4099-abae-1ac6014f03cf tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:40.214143 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5521026c-7b91-4099-abae-1ac6014f03cf tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:40.221247 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5521026c-7b91-4099-abae-1ac6014f03cf tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:40.221703 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5521026c-7b91-4099-abae-1ac6014f03cf tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:40.222487 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5521026c-7b91-4099-abae-1ac6014f03cf tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:40.222963 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5521026c-7b91-4099-abae-1ac6014f03cf tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:40.395865 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-5521026c-7b91-4099-abae-1ac6014f03cf tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:40.406832 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5521026c-7b91-4099-abae-1ac6014f03cf tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1756 microversion: 2.1 time: 0.197515 Jul 28 04:08:40.407509 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 511/961] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:40 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1756 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:40.481585 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-5d61ebaa-0e53-487c-bbed-4b7fa35f558d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:40.482133 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-5d61ebaa-0e53-487c-bbed-4b7fa35f558d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:40.489412 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5d61ebaa-0e53-487c-bbed-4b7fa35f558d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:40.489854 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5d61ebaa-0e53-487c-bbed-4b7fa35f558d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:40.490612 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5d61ebaa-0e53-487c-bbed-4b7fa35f558d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:40.491071 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5d61ebaa-0e53-487c-bbed-4b7fa35f558d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:40.590649 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-5d61ebaa-0e53-487c-bbed-4b7fa35f558d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:40.594863 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=100 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:40.600016 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-5d61ebaa-0e53-487c-bbed-4b7fa35f558d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:40.601517 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-5d61ebaa-0e53-487c-bbed-4b7fa35f558d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:40.602619 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-5d61ebaa-0e53-487c-bbed-4b7fa35f558d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1340 microversion: 2.20 time: 0.125097 Jul 28 04:08:40.603231 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 451/962] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:08:40 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1340 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:08:41.429214 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-60cb7eab-e823-451f-9005-b15fde53f231 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:41.429838 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-60cb7eab-e823-451f-9005-b15fde53f231 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:41.437250 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-60cb7eab-e823-451f-9005-b15fde53f231 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:41.437731 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-60cb7eab-e823-451f-9005-b15fde53f231 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:41.438517 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-60cb7eab-e823-451f-9005-b15fde53f231 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:41.439001 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-60cb7eab-e823-451f-9005-b15fde53f231 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:41.593133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-60cb7eab-e823-451f-9005-b15fde53f231 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:41.602155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-60cb7eab-e823-451f-9005-b15fde53f231 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1756 microversion: 2.1 time: 0.176837 Jul 28 04:08:41.602745 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 512/963] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:41 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1756 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:41.626854 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-781fc51c-fe08-4aa2-802e-ae7d1634196d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:41.627478 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-781fc51c-fe08-4aa2-802e-ae7d1634196d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:41.634943 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-781fc51c-fe08-4aa2-802e-ae7d1634196d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:41.635523 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-781fc51c-fe08-4aa2-802e-ae7d1634196d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:41.636545 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-781fc51c-fe08-4aa2-802e-ae7d1634196d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:41.637075 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-781fc51c-fe08-4aa2-802e-ae7d1634196d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:41.769069 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-f987a751-ac1c-4860-bbcf-f9797d209a43 req-756a9ee1-9243-4ebb-b7ae-4cff98584fab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b67751f-bbbc-48cc-9286-3312b89f746d", "tag": "f5acb90a-f577-4063-9575-472c6b002484"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:41.786696 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-f987a751-ac1c-4860-bbcf-f9797d209a43 req-756a9ee1-9243-4ebb-b7ae-4cff98584fab service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:41.787443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-f987a751-ac1c-4860-bbcf-f9797d209a43 req-756a9ee1-9243-4ebb-b7ae-4cff98584fab service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:41.801700 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-f987a751-ac1c-4860-bbcf-f9797d209a43 req-756a9ee1-9243-4ebb-b7ae-4cff98584fab service nova] Creating event network-changed:f5acb90a-f577-4063-9575-472c6b002484 for instance 7b67751f-bbbc-48cc-9286-3312b89f746d on hv-cinder-79987 Jul 28 04:08:41.806850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-f987a751-ac1c-4860-bbcf-f9797d209a43 req-756a9ee1-9243-4ebb-b7ae-4cff98584fab service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044161 Jul 28 04:08:41.807457 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 513/964] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:08:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:08:41.894409 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-781fc51c-fe08-4aa2-802e-ae7d1634196d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:41.904482 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-781fc51c-fe08-4aa2-802e-ae7d1634196d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:41.906287 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-781fc51c-fe08-4aa2-802e-ae7d1634196d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:41.907552 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-781fc51c-fe08-4aa2-802e-ae7d1634196d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1407 microversion: 2.20 time: 0.285790 Jul 28 04:08:41.908210 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 452/965] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:08:41 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:08:42.626335 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-eff8f5b6-79dc-4397-8d6d-7468c844eb63 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:42.627263 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-eff8f5b6-79dc-4397-8d6d-7468c844eb63 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:42.633524 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-eff8f5b6-79dc-4397-8d6d-7468c844eb63 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:42.633977 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-eff8f5b6-79dc-4397-8d6d-7468c844eb63 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:42.634734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-eff8f5b6-79dc-4397-8d6d-7468c844eb63 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:42.635201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-eff8f5b6-79dc-4397-8d6d-7468c844eb63 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:42.781463 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-eff8f5b6-79dc-4397-8d6d-7468c844eb63 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:42.789900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-eff8f5b6-79dc-4397-8d6d-7468c844eb63 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1756 microversion: 2.1 time: 0.169075 Jul 28 04:08:42.790406 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 514/966] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:42 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:42.930158 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-cb2810a1-ad7c-4c2d-811a-2e121e6e3214 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:42.930797 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-cb2810a1-ad7c-4c2d-811a-2e121e6e3214 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:42.938043 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-cb2810a1-ad7c-4c2d-811a-2e121e6e3214 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:42.938497 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-cb2810a1-ad7c-4c2d-811a-2e121e6e3214 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:42.939295 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-cb2810a1-ad7c-4c2d-811a-2e121e6e3214 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:42.939735 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-cb2810a1-ad7c-4c2d-811a-2e121e6e3214 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:43.071353 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-cb2810a1-ad7c-4c2d-811a-2e121e6e3214 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:43.081136 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-cb2810a1-ad7c-4c2d-811a-2e121e6e3214 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:43.082681 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-cb2810a1-ad7c-4c2d-811a-2e121e6e3214 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:43.083827 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-cb2810a1-ad7c-4c2d-811a-2e121e6e3214 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1407 microversion: 2.20 time: 0.157593 Jul 28 04:08:43.091990 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 453/967] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:08:42 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:08:43.811941 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-64b904f3-4c2d-4f70-999e-b7e29fe46b50 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:43.812554 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-64b904f3-4c2d-4f70-999e-b7e29fe46b50 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:43.819073 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-64b904f3-4c2d-4f70-999e-b7e29fe46b50 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:43.819507 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-64b904f3-4c2d-4f70-999e-b7e29fe46b50 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:43.820262 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-64b904f3-4c2d-4f70-999e-b7e29fe46b50 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:43.820694 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-64b904f3-4c2d-4f70-999e-b7e29fe46b50 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:43.960325 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-64b904f3-4c2d-4f70-999e-b7e29fe46b50 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:43.968419 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-64b904f3-4c2d-4f70-999e-b7e29fe46b50 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1756 microversion: 2.1 time: 0.160954 Jul 28 04:08:43.968972 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 515/968] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:43 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:44.105359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-5f83ead6-a093-45f0-a4a3-e4a2f5a23fa5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:44.105976 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-5f83ead6-a093-45f0-a4a3-e4a2f5a23fa5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:44.113084 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5f83ead6-a093-45f0-a4a3-e4a2f5a23fa5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:44.113528 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5f83ead6-a093-45f0-a4a3-e4a2f5a23fa5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:44.114283 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5f83ead6-a093-45f0-a4a3-e4a2f5a23fa5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:44.114713 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5f83ead6-a093-45f0-a4a3-e4a2f5a23fa5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:44.240246 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-5f83ead6-a093-45f0-a4a3-e4a2f5a23fa5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:44.248195 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-5f83ead6-a093-45f0-a4a3-e4a2f5a23fa5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:44.249922 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-5f83ead6-a093-45f0-a4a3-e4a2f5a23fa5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:44.251065 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-5f83ead6-a093-45f0-a4a3-e4a2f5a23fa5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1407 microversion: 2.20 time: 0.149585 Jul 28 04:08:44.251631 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 454/969] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:08:44 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:08:44.989336 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-322060ce-c0e6-40ce-bcba-08b5f04b6a2a tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:44.989949 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-322060ce-c0e6-40ce-bcba-08b5f04b6a2a tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:44.996478 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-322060ce-c0e6-40ce-bcba-08b5f04b6a2a tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:44.996929 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-322060ce-c0e6-40ce-bcba-08b5f04b6a2a tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:44.997684 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-322060ce-c0e6-40ce-bcba-08b5f04b6a2a tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:44.998702 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-322060ce-c0e6-40ce-bcba-08b5f04b6a2a tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:45.147618 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-322060ce-c0e6-40ce-bcba-08b5f04b6a2a tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:45.155917 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-322060ce-c0e6-40ce-bcba-08b5f04b6a2a tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1756 microversion: 2.1 time: 0.170416 Jul 28 04:08:45.156493 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 516/970] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:44 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:45.273837 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-4dd1f83d-1045-4b2b-966a-9a70f4c975bc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:45.274460 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-4dd1f83d-1045-4b2b-966a-9a70f4c975bc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:45.281516 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4dd1f83d-1045-4b2b-966a-9a70f4c975bc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:45.281973 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4dd1f83d-1045-4b2b-966a-9a70f4c975bc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:45.282740 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4dd1f83d-1045-4b2b-966a-9a70f4c975bc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:45.283208 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4dd1f83d-1045-4b2b-966a-9a70f4c975bc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:45.418304 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-4dd1f83d-1045-4b2b-966a-9a70f4c975bc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:45.427070 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-4dd1f83d-1045-4b2b-966a-9a70f4c975bc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:45.428618 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-4dd1f83d-1045-4b2b-966a-9a70f4c975bc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:45.429736 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-4dd1f83d-1045-4b2b-966a-9a70f4c975bc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1407 microversion: 2.20 time: 0.160062 Jul 28 04:08:45.430311 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 455/971] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:08:45 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:08:46.177690 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e01c5402-0092-426c-b991-e1bc182054b7 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:46.178297 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e01c5402-0092-426c-b991-e1bc182054b7 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:46.184803 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e01c5402-0092-426c-b991-e1bc182054b7 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:46.185249 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e01c5402-0092-426c-b991-e1bc182054b7 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:46.186739 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e01c5402-0092-426c-b991-e1bc182054b7 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:46.187194 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e01c5402-0092-426c-b991-e1bc182054b7 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:46.326319 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e01c5402-0092-426c-b991-e1bc182054b7 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:46.334501 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e01c5402-0092-426c-b991-e1bc182054b7 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1759 microversion: 2.1 time: 0.160779 Jul 28 04:08:46.335123 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 517/972] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:08:46 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1759 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:08:46.452954 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-157723bf-ca0d-426f-9616-ae09281061e5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:46.453481 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-157723bf-ca0d-426f-9616-ae09281061e5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:46.460101 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-157723bf-ca0d-426f-9616-ae09281061e5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:46.460588 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-157723bf-ca0d-426f-9616-ae09281061e5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:46.461359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-157723bf-ca0d-426f-9616-ae09281061e5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:46.461797 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-157723bf-ca0d-426f-9616-ae09281061e5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:46.589773 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-157723bf-ca0d-426f-9616-ae09281061e5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:46.599331 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-157723bf-ca0d-426f-9616-ae09281061e5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:46.600828 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-157723bf-ca0d-426f-9616-ae09281061e5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:46.601930 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-157723bf-ca0d-426f-9616-ae09281061e5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1407 microversion: 2.20 time: 0.153208 Jul 28 04:08:46.602486 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 456/973] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:08:46 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:08:47.134127 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-bc697879-9117-4adf-90f6-823aca1d6d09 req-470b64e9-a4d2-455e-946e-e6d0694de36b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b67751f-bbbc-48cc-9286-3312b89f746d", "name": "network-vif-plugged", "status": "completed", "tag": "f5acb90a-f577-4063-9575-472c6b002484"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:47.143142 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:47.145785 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-bc697879-9117-4adf-90f6-823aca1d6d09 req-470b64e9-a4d2-455e-946e-e6d0694de36b service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:47.146872 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-bc697879-9117-4adf-90f6-823aca1d6d09 req-470b64e9-a4d2-455e-946e-e6d0694de36b service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:47.160584 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-bc697879-9117-4adf-90f6-823aca1d6d09 req-470b64e9-a4d2-455e-946e-e6d0694de36b service nova] Creating event network-vif-plugged:f5acb90a-f577-4063-9575-472c6b002484 for instance 7b67751f-bbbc-48cc-9286-3312b89f746d on hv-cinder-79987 Jul 28 04:08:47.165744 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-bc697879-9117-4adf-90f6-823aca1d6d09 req-470b64e9-a4d2-455e-946e-e6d0694de36b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035356 Jul 28 04:08:47.166730 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 518/974] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:08:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:08:47.625605 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-93edcabb-c05c-463a-a0b4-e5fdc598a4e2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:47.626232 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-93edcabb-c05c-463a-a0b4-e5fdc598a4e2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:47.633141 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-93edcabb-c05c-463a-a0b4-e5fdc598a4e2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:47.633588 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-93edcabb-c05c-463a-a0b4-e5fdc598a4e2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:47.634365 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-93edcabb-c05c-463a-a0b4-e5fdc598a4e2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:47.634820 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-93edcabb-c05c-463a-a0b4-e5fdc598a4e2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:47.760440 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-93edcabb-c05c-463a-a0b4-e5fdc598a4e2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:47.768338 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-93edcabb-c05c-463a-a0b4-e5fdc598a4e2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:47.769852 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-93edcabb-c05c-463a-a0b4-e5fdc598a4e2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:47.771001 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-93edcabb-c05c-463a-a0b4-e5fdc598a4e2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1407 microversion: 2.20 time: 0.149991 Jul 28 04:08:47.771565 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 457/975] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:08:47 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1407 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:08:48.794338 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3f7868af-addc-4d75-9a04-9a7d48e4c80e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:48.795067 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3f7868af-addc-4d75-9a04-9a7d48e4c80e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:48.803158 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3f7868af-addc-4d75-9a04-9a7d48e4c80e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:48.803645 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3f7868af-addc-4d75-9a04-9a7d48e4c80e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:48.804411 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3f7868af-addc-4d75-9a04-9a7d48e4c80e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:48.804848 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3f7868af-addc-4d75-9a04-9a7d48e4c80e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:48.934899 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3f7868af-addc-4d75-9a04-9a7d48e4c80e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:48.943517 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3f7868af-addc-4d75-9a04-9a7d48e4c80e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:48.945138 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3f7868af-addc-4d75-9a04-9a7d48e4c80e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:48.946332 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3f7868af-addc-4d75-9a04-9a7d48e4c80e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1407 microversion: 2.20 time: 0.156538 Jul 28 04:08:48.946915 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 519/976] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:08:48 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:08:49.971082 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-6526509e-2cb3-4e27-a9da-f1bd96fdef60 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:49.971692 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-6526509e-2cb3-4e27-a9da-f1bd96fdef60 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:49.974006 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell0:SELECT=6 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:49.974642 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:49.981058 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6526509e-2cb3-4e27-a9da-f1bd96fdef60 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:49.981498 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6526509e-2cb3-4e27-a9da-f1bd96fdef60 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:49.982258 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6526509e-2cb3-4e27-a9da-f1bd96fdef60 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:49.982684 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-6526509e-2cb3-4e27-a9da-f1bd96fdef60 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:50.115507 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-6526509e-2cb3-4e27-a9da-f1bd96fdef60 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:50.123385 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-6526509e-2cb3-4e27-a9da-f1bd96fdef60 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:50.125422 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-6526509e-2cb3-4e27-a9da-f1bd96fdef60 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:08:50.126566 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-6526509e-2cb3-4e27-a9da-f1bd96fdef60 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1599 microversion: 2.20 time: 0.160010 Jul 28 04:08:50.127160 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 458/977] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:08:49 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1599 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:08:50.149023 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-5bf1d6e0-6d21-4be9-8d67-b41a71b0567f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:08:50.149516 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-5bf1d6e0-6d21-4be9-8d67-b41a71b0567f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:08:50.151469 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:50.152240 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=6 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:08:50.158675 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5bf1d6e0-6d21-4be9-8d67-b41a71b0567f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:50.159167 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5bf1d6e0-6d21-4be9-8d67-b41a71b0567f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:50.159924 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5bf1d6e0-6d21-4be9-8d67-b41a71b0567f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:50.160360 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-5bf1d6e0-6d21-4be9-8d67-b41a71b0567f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:50.241018 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-5bf1d6e0-6d21-4be9-8d67-b41a71b0567f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.095784 Jul 28 04:08:50.241615 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 520/978] 10.222.0.46 () {60 vars in 1316 bytes} [Thu Jul 28 04:08:50 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:08:51.390470 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-f8e80767-733a-4d69-b169-e2047cc00536 req-e78f9120-2ea8-4138-a563-04be4eecabac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7b67751f-bbbc-48cc-9286-3312b89f746d", "tag": "f5acb90a-f577-4063-9575-472c6b002484"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:08:51.400285 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-f8e80767-733a-4d69-b169-e2047cc00536 req-e78f9120-2ea8-4138-a563-04be4eecabac service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:08:51.400722 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-f8e80767-733a-4d69-b169-e2047cc00536 req-e78f9120-2ea8-4138-a563-04be4eecabac service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:08:51.412251 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-f8e80767-733a-4d69-b169-e2047cc00536 req-e78f9120-2ea8-4138-a563-04be4eecabac service nova] Creating event network-changed:f5acb90a-f577-4063-9575-472c6b002484 for instance 7b67751f-bbbc-48cc-9286-3312b89f746d on hv-cinder-79987 Jul 28 04:08:51.417390 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-f8e80767-733a-4d69-b169-e2047cc00536 req-e78f9120-2ea8-4138-a563-04be4eecabac service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031082 Jul 28 04:08:51.418154 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 459/979] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:08:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:09:24.907029 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=5 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:24.908102 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=88 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:24.911810 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c8ca28ef-045a-448a-824a-d70b03acdecc tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-917167549"}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:09:24.912592 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c8ca28ef-045a-448a-824a-d70b03acdecc tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:24.919295 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c8ca28ef-045a-448a-824a-d70b03acdecc tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:24.919747 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c8ca28ef-045a-448a-824a-d70b03acdecc tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:24.920500 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c8ca28ef-045a-448a-824a-d70b03acdecc tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:24.920929 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c8ca28ef-045a-448a-824a-d70b03acdecc tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:25.047673 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.network.security_group_api [None req-c8ca28ef-045a-448a-824a-d70b03acdecc tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Removing security group 26b7b123-710f-4e2a-b942-298b57bfb259 from port ec8710cf-b9f9-4fb9-a83d-176eeaf7d403 Jul 28 04:09:25.411195 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c8ca28ef-045a-448a-824a-d70b03acdecc tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "POST /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7/action" status: 202 len: 0 microversion: 2.1 time: 0.506129 Jul 28 04:09:25.416763 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=3 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:25.417488 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=44 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:25.421849 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 521/980] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Jul 28 04:09:24 2022] POST /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:09:25.423793 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-719da174-3efb-4d4d-9951-d1594bcae86e req-c614b800-73f4-4ba5-abd0-b6474d2cc6cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b39f037b-6003-425c-bf7d-37a9432efbf7", "tag": "ec8710cf-b9f9-4fb9-a83d-176eeaf7d403"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:09:25.435579 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-719da174-3efb-4d4d-9951-d1594bcae86e req-c614b800-73f4-4ba5-abd0-b6474d2cc6cc service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:25.436020 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-719da174-3efb-4d4d-9951-d1594bcae86e req-c614b800-73f4-4ba5-abd0-b6474d2cc6cc service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:25.449440 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-719da174-3efb-4d4d-9951-d1594bcae86e req-c614b800-73f4-4ba5-abd0-b6474d2cc6cc service nova] Creating event network-changed:ec8710cf-b9f9-4fb9-a83d-176eeaf7d403 for instance b39f037b-6003-425c-bf7d-37a9432efbf7 on hv-cinder-79987 Jul 28 04:09:25.456323 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-719da174-3efb-4d4d-9951-d1594bcae86e req-c614b800-73f4-4ba5-abd0-b6474d2cc6cc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041099 Jul 28 04:09:25.457037 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 460/981] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:09:26.606372 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2b8ba702-b83b-49eb-beaa-bae85a84379d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:26.607016 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-2b8ba702-b83b-49eb-beaa-bae85a84379d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:26.613252 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2b8ba702-b83b-49eb-beaa-bae85a84379d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:26.613786 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2b8ba702-b83b-49eb-beaa-bae85a84379d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:26.614611 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2b8ba702-b83b-49eb-beaa-bae85a84379d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:26.615137 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2b8ba702-b83b-49eb-beaa-bae85a84379d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:26.699774 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.objects.instance [None req-2b8ba702-b83b-49eb-beaa-bae85a84379d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lazy-loading 'services' on Instance uuid b39f037b-6003-425c-bf7d-37a9432efbf7 {{(pid=118187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:09:26.772704 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-2b8ba702-b83b-49eb-beaa-bae85a84379d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7/os-volume_attachments/a8d8c1e2-7a3e-4802-b5e0-1506bbbf2781" status: 202 len: 0 microversion: 2.1 time: 0.170680 Jul 28 04:09:26.773507 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 522/982] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Jul 28 04:09:26 2022] DELETE /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7/os-volume_attachments/a8d8c1e2-7a3e-4802-b5e0-1506bbbf2781 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:09:26.784376 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-e1bc7fd6-5e9c-4325-af09-53d891473e18 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:26.786763 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-e1bc7fd6-5e9c-4325-af09-53d891473e18 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:26.793851 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e1bc7fd6-5e9c-4325-af09-53d891473e18 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:26.794356 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e1bc7fd6-5e9c-4325-af09-53d891473e18 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:26.795223 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e1bc7fd6-5e9c-4325-af09-53d891473e18 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:26.795849 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e1bc7fd6-5e9c-4325-af09-53d891473e18 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:26.831791 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-e1bc7fd6-5e9c-4325-af09-53d891473e18 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053037 Jul 28 04:09:26.832640 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 461/983] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Jul 28 04:09:26 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:09:27.488395 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-eaec0b4f-5640-4b1b-9fb0-fbfca6e821d1 req-b6ba2716-4bf8-4c72-891b-4fe04f07a987 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b39f037b-6003-425c-bf7d-37a9432efbf7", "tag": "ec8710cf-b9f9-4fb9-a83d-176eeaf7d403"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:09:27.498106 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-eaec0b4f-5640-4b1b-9fb0-fbfca6e821d1 req-b6ba2716-4bf8-4c72-891b-4fe04f07a987 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:27.498548 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-eaec0b4f-5640-4b1b-9fb0-fbfca6e821d1 req-b6ba2716-4bf8-4c72-891b-4fe04f07a987 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:27.509846 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-eaec0b4f-5640-4b1b-9fb0-fbfca6e821d1 req-b6ba2716-4bf8-4c72-891b-4fe04f07a987 service nova] Creating event network-changed:ec8710cf-b9f9-4fb9-a83d-176eeaf7d403 for instance b39f037b-6003-425c-bf7d-37a9432efbf7 on hv-cinder-79987 Jul 28 04:09:27.514530 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-eaec0b4f-5640-4b1b-9fb0-fbfca6e821d1 req-b6ba2716-4bf8-4c72-891b-4fe04f07a987 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030758 Jul 28 04:09:27.515153 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 523/984] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:09:27.844225 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-285a6f56-2ef6-400e-bab3-1c1f733bc82d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:27.846443 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-285a6f56-2ef6-400e-bab3-1c1f733bc82d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:27.853010 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-285a6f56-2ef6-400e-bab3-1c1f733bc82d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:27.853461 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-285a6f56-2ef6-400e-bab3-1c1f733bc82d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:27.854226 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-285a6f56-2ef6-400e-bab3-1c1f733bc82d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:27.854664 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-285a6f56-2ef6-400e-bab3-1c1f733bc82d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:27.883862 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-285a6f56-2ef6-400e-bab3-1c1f733bc82d tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044107 Jul 28 04:09:27.884632 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 462/985] 10.222.0.46 () {58 vars in 1302 bytes} [Thu Jul 28 04:09:27 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 28 04:09:27.895937 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-52e0ad98-6c7d-489c-ae2f-65d3dc8cca59 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:27.896528 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-52e0ad98-6c7d-489c-ae2f-65d3dc8cca59 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:27.902915 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-52e0ad98-6c7d-489c-ae2f-65d3dc8cca59 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:27.903284 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-52e0ad98-6c7d-489c-ae2f-65d3dc8cca59 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:27.904103 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-52e0ad98-6c7d-489c-ae2f-65d3dc8cca59 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:27.904527 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-52e0ad98-6c7d-489c-ae2f-65d3dc8cca59 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:27.985148 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-52e0ad98-6c7d-489c-ae2f-65d3dc8cca59 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] HTTP exception thrown: Instance b39f037b-6003-425c-bf7d-37a9432efbf7 is not attached to volume a8d8c1e2-7a3e-4802-b5e0-1506bbbf2781 Jul 28 04:09:27.991364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-52e0ad98-6c7d-489c-ae2f-65d3dc8cca59 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Request method failure captured: Jul 28 04:09:27.991364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: DELETE /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7/os-volume_attachments/a8d8c1e2-7a3e-4802-b5e0-1506bbbf2781 HTTP/1.1 Jul 28 04:09:27.991364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:09:27.991364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:09:27.991364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:09:27.991364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:09:27.991364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:09:27.991364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:09:27.991364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:09:27.991364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:09:27.991364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gtrBAF8OFsCkGEhQll11OkC1ZlV78GI8FaD-W545zO3g_SD3c_RrmYm1-lOtFbW446Am48xKHHzmjuRJnDpBgAATGh-prCorZfWzGkB6GTHLEqKpvO-6Vdl8SDyB1GPOAK801EqhVJnFOAPZc5hDyTeDYMTVMG1ZCFMIewLnGpMYZM Jul 28 04:09:27.991364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:09:27.991364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:09:27.991364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:09:27.991364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:09:27.991364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:09:27.991364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:09:27.991364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 346eb7e46ec54cf087d8b39379cf5129 Jul 28 04:09:27.991364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-TestMinimumBasicScenario-2012476593 Jul 28 04:09:27.991364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:09:27.991364 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:09:27.992849 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_346eb7e46ec54cf087d8b39379cf5129", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/346eb7e46ec54cf087d8b39379cf5129"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/346eb7e46ec54cf087d8b39379cf5129"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/346eb7e46ec54cf087d8b39379cf5129"}]}] Jul 28 04:09:27.992849 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-TestMinimumBasicScenario-2012476593 Jul 28 04:09:27.992849 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 346eb7e46ec54cf087d8b39379cf5129 Jul 28 04:09:27.992849 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2012476593 Jul 28 04:09:27.992849 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-TestMinimumBasicScenario-2012476593-project Jul 28 04:09:27.992849 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:09:27.992849 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:09:27.992849 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: 9d30603fefe44a0c9dbed8c170071b09 Jul 28 04:09:27.992849 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-TestMinimumBasicScenario-2012476593-project Jul 28 04:09:27.992849 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:09:27.992849 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Instance b39f037b-6003-425c-bf7d-37a9432efbf7 is not attached to volume a8d8c1e2-7a3e-4802-b5e0-1506bbbf2781 Jul 28 04:09:27.993617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'server_id': 'b39f037b-6003-425c-bf7d-37a9432efbf7', 'id': 'a8d8c1e2-7a3e-4802-b5e0-1506bbbf2781'} Jul 28 04:09:27.993617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:09:27.993617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:09:27.993617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 28 04:09:27.993617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 28 04:09:27.993617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 28 04:09:27.993617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 28 04:09:27.993617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 28 04:09:27.993617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 28 04:09:27.993617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a8d8c1e2-7a3e-4802-b5e0-1506bbbf2781. Jul 28 04:09:27.993617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:09:27.993617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:09:27.993617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:09:27.993617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:09:27.993617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:09:27.993617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:09:27.993617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:09:27.993617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:09:27.993617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:09:27.994961 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:09:27.994961 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 28 04:09:27.994961 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 28 04:09:27.994961 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b39f037b-6003-425c-bf7d-37a9432efbf7 is not attached to volume a8d8c1e2-7a3e-4802-b5e0-1506bbbf2781 Jul 28 04:09:27.994961 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:09:27.994961 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:09:27.994961 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:09:27.994961 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:09:27.994961 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:09:27.994961 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:09:27.994961 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:09:27.994961 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:09:27.994961 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b39f037b-6003-425c-bf7d-37a9432efbf7 is not attached to volume a8d8c1e2-7a3e-4802-b5e0-1506bbbf2781 Jul 28 04:09:27.994961 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:09:27.994961 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-52e0ad98-6c7d-489c-ae2f-65d3dc8cca59 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Returning 404 to user: Instance b39f037b-6003-425c-bf7d-37a9432efbf7 is not attached to volume a8d8c1e2-7a3e-4802-b5e0-1506bbbf2781 {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:09:27.995962 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-52e0ad98-6c7d-489c-ae2f-65d3dc8cca59 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7/os-volume_attachments/a8d8c1e2-7a3e-4802-b5e0-1506bbbf2781" status: 404 len: 154 microversion: 2.1 time: 0.101927 Jul 28 04:09:27.995962 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 524/986] 10.222.0.46 () {58 vars in 1416 bytes} [Thu Jul 28 04:09:27 2022] DELETE /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7/os-volume_attachments/a8d8c1e2-7a3e-4802-b5e0-1506bbbf2781 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:09:29.147145 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-3997271c-1795-4a9d-9e4e-c784cea813ec tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:29.147631 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-3997271c-1795-4a9d-9e4e-c784cea813ec tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:29.154116 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3997271c-1795-4a9d-9e4e-c784cea813ec tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:29.154567 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3997271c-1795-4a9d-9e4e-c784cea813ec tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:29.155359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3997271c-1795-4a9d-9e4e-c784cea813ec tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:29.155798 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3997271c-1795-4a9d-9e4e-c784cea813ec tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:29.179656 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-3997271c-1795-4a9d-9e4e-c784cea813ec tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Going to try to terminate instance {{(pid=118186) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:09:29.254647 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-3997271c-1795-4a9d-9e4e-c784cea813ec tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "DELETE /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 204 len: 0 microversion: 2.1 time: 0.110903 Jul 28 04:09:29.255289 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 463/987] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:09:29 2022] DELETE /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:09:29.263741 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b596a335-d012-4ef2-ac51-649bedc57177 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:29.264960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b596a335-d012-4ef2-ac51-649bedc57177 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:29.272185 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b596a335-d012-4ef2-ac51-649bedc57177 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:29.272637 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b596a335-d012-4ef2-ac51-649bedc57177 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:29.273397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b596a335-d012-4ef2-ac51-649bedc57177 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:29.273833 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b596a335-d012-4ef2-ac51-649bedc57177 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:29.407442 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b596a335-d012-4ef2-ac51-649bedc57177 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:29.415813 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b596a335-d012-4ef2-ac51-649bedc57177 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1554 microversion: 2.1 time: 0.155990 Jul 28 04:09:29.416379 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 525/988] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:29 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1554 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:30.438007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-586fc0b1-7a22-400c-bd83-2a4db03c3b85 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:30.438729 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-586fc0b1-7a22-400c-bd83-2a4db03c3b85 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:30.445149 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-586fc0b1-7a22-400c-bd83-2a4db03c3b85 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:30.445597 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-586fc0b1-7a22-400c-bd83-2a4db03c3b85 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:30.446356 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-586fc0b1-7a22-400c-bd83-2a4db03c3b85 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:30.446801 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-586fc0b1-7a22-400c-bd83-2a4db03c3b85 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:30.632115 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-586fc0b1-7a22-400c-bd83-2a4db03c3b85 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:30.639705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-586fc0b1-7a22-400c-bd83-2a4db03c3b85 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1554 microversion: 2.1 time: 0.206543 Jul 28 04:09:30.640300 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 464/989] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:30 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1554 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:31.567521 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-e5677c4c-d929-4dcf-81db-e1663b792ed8 req-d2e006ef-c1ec-4479-801b-096bd058e086 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b39f037b-6003-425c-bf7d-37a9432efbf7", "name": "network-vif-deleted", "tag": "ec8710cf-b9f9-4fb9-a83d-176eeaf7d403"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:09:31.584173 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-e5677c4c-d929-4dcf-81db-e1663b792ed8 req-d2e006ef-c1ec-4479-801b-096bd058e086 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:31.584627 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-e5677c4c-d929-4dcf-81db-e1663b792ed8 req-d2e006ef-c1ec-4479-801b-096bd058e086 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:31.597651 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-e5677c4c-d929-4dcf-81db-e1663b792ed8 req-d2e006ef-c1ec-4479-801b-096bd058e086 service nova] Creating event network-vif-deleted:ec8710cf-b9f9-4fb9-a83d-176eeaf7d403 for instance b39f037b-6003-425c-bf7d-37a9432efbf7 on hv-cinder-79987 Jul 28 04:09:31.603121 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-e5677c4c-d929-4dcf-81db-e1663b792ed8 req-d2e006ef-c1ec-4479-801b-096bd058e086 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039196 Jul 28 04:09:31.603712 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 526/990] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:09:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:09:31.661335 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c3b269ae-5c3c-4221-9fcf-7ccad8ad69c8 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:31.662215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c3b269ae-5c3c-4221-9fcf-7ccad8ad69c8 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:31.668866 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c3b269ae-5c3c-4221-9fcf-7ccad8ad69c8 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:31.669329 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c3b269ae-5c3c-4221-9fcf-7ccad8ad69c8 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:31.670101 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c3b269ae-5c3c-4221-9fcf-7ccad8ad69c8 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:31.670543 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c3b269ae-5c3c-4221-9fcf-7ccad8ad69c8 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:31.704129 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c3b269ae-5c3c-4221-9fcf-7ccad8ad69c8 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:31.704591 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c3b269ae-5c3c-4221-9fcf-7ccad8ad69c8 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:31.705037 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.objects.instance [None req-c3b269ae-5c3c-4221-9fcf-7ccad8ad69c8 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lazy-loading 'fault' on Instance uuid b39f037b-6003-425c-bf7d-37a9432efbf7 {{(pid=118186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:09:31.745956 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-c3b269ae-5c3c-4221-9fcf-7ccad8ad69c8 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d30603fefe44a0c9dbed8c170071b09', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '346eb7e46ec54cf087d8b39379cf5129', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:31.753984 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-c3b269ae-5c3c-4221-9fcf-7ccad8ad69c8 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 200 len: 1348 microversion: 2.1 time: 0.096673 Jul 28 04:09:31.754554 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 465/991] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:31 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 1348 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:09:32.776365 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ec996540-200f-42e8-8fc8-09a26c0d94f3 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:32.777099 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ec996540-200f-42e8-8fc8-09a26c0d94f3 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] [instance: b39f037b-6003-425c-bf7d-37a9432efbf7] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:32.784459 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ec996540-200f-42e8-8fc8-09a26c0d94f3 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:32.784918 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ec996540-200f-42e8-8fc8-09a26c0d94f3 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:32.785684 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ec996540-200f-42e8-8fc8-09a26c0d94f3 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:32.786129 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ec996540-200f-42e8-8fc8-09a26c0d94f3 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:32.799347 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-ec996540-200f-42e8-8fc8-09a26c0d94f3 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] HTTP exception thrown: Instance b39f037b-6003-425c-bf7d-37a9432efbf7 could not be found. Jul 28 04:09:32.800960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ec996540-200f-42e8-8fc8-09a26c0d94f3 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Request method failure captured: Jul 28 04:09:32.800960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 HTTP/1.1 Jul 28 04:09:32.800960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:09:32.800960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:09:32.800960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:09:32.800960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:09:32.800960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:09:32.800960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:09:32.800960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:09:32.800960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:09:32.800960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gtrBAF8OFsCkGEhQll11OkC1ZlV78GI8FaD-W545zO3g_SD3c_RrmYm1-lOtFbW446Am48xKHHzmjuRJnDpBgAATGh-prCorZfWzGkB6GTHLEqKpvO-6Vdl8SDyB1GPOAK801EqhVJnFOAPZc5hDyTeDYMTVMG1ZCFMIewLnGpMYZM Jul 28 04:09:32.800960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:09:32.800960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:09:32.800960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:09:32.800960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:09:32.800960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:09:32.800960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:09:32.800960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 346eb7e46ec54cf087d8b39379cf5129 Jul 28 04:09:32.800960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-TestMinimumBasicScenario-2012476593 Jul 28 04:09:32.800960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:09:32.800960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:09:32.802493 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_346eb7e46ec54cf087d8b39379cf5129", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/346eb7e46ec54cf087d8b39379cf5129"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/346eb7e46ec54cf087d8b39379cf5129"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/346eb7e46ec54cf087d8b39379cf5129"}]}] Jul 28 04:09:32.802493 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-TestMinimumBasicScenario-2012476593 Jul 28 04:09:32.802493 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 346eb7e46ec54cf087d8b39379cf5129 Jul 28 04:09:32.802493 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2012476593 Jul 28 04:09:32.802493 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-TestMinimumBasicScenario-2012476593-project Jul 28 04:09:32.802493 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:09:32.802493 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:09:32.802493 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: 9d30603fefe44a0c9dbed8c170071b09 Jul 28 04:09:32.802493 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-TestMinimumBasicScenario-2012476593-project Jul 28 04:09:32.802493 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:09:32.802493 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Instance b39f037b-6003-425c-bf7d-37a9432efbf7 could not be found. Jul 28 04:09:32.802493 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': 'b39f037b-6003-425c-bf7d-37a9432efbf7'} Jul 28 04:09:32.803397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:09:32.803397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:09:32.803397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:09:32.803397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:09:32.803397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:09:32.803397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:09:32.803397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:09:32.803397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:09:32.803397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:09:32.803397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:09:32.803397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b39f037b-6003-425c-bf7d-37a9432efbf7 could not be found. Jul 28 04:09:32.803397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:09:32.803397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:09:32.803397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:09:32.803397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:09:32.803397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:09:32.803397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:09:32.803397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:09:32.803397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:09:32.803397 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:09:32.804665 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:09:32.804665 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:09:32.804665 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:09:32.804665 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:09:32.804665 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:09:32.804665 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:09:32.804665 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:09:32.804665 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b39f037b-6003-425c-bf7d-37a9432efbf7 could not be found. Jul 28 04:09:32.804665 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:09:32.804665 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:09:32.804665 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:09:32.804665 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:09:32.804665 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:09:32.804665 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:09:32.804665 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:09:32.804665 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:09:32.804665 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b39f037b-6003-425c-bf7d-37a9432efbf7 could not be found. Jul 28 04:09:32.804665 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:09:32.805896 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ec996540-200f-42e8-8fc8-09a26c0d94f3 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Returning 404 to user: Instance b39f037b-6003-425c-bf7d-37a9432efbf7 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:09:32.805896 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ec996540-200f-42e8-8fc8-09a26c0d94f3 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7" status: 404 len: 111 microversion: 2.1 time: 0.030192 Jul 28 04:09:32.805896 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 527/992] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:09:32 2022] GET /compute/v2.1/servers/b39f037b-6003-425c-bf7d-37a9432efbf7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:09:32.810861 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-809ba71b-bc1c-408a-b1ab-51b8f5eb1716 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] Calling method '.version_select at 0x7fa6edfc8310>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:32.829855 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-809ba71b-bc1c-408a-b1ab-51b8f5eb1716 tempest-TestMinimumBasicScenario-2012476593 tempest-TestMinimumBasicScenario-2012476593-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1267502620" status: 202 len: 0 microversion: 2.1 time: 0.022795 Jul 28 04:09:32.830420 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 466/993] 10.222.0.46 () {58 vars in 1272 bytes} [Thu Jul 28 04:09:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1267502620 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:09:45.583382 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:09:45.584029 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Thu Jul 28 04:09:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:09:54.109932 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-30ce046a-5f9c-41d6-99d7-45038270eb28 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:54.110504 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-30ce046a-5f9c-41d6-99d7-45038270eb28 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:54.112755 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=14 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:54.113400 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=31,nova_cell1:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:54.119174 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-30ce046a-5f9c-41d6-99d7-45038270eb28 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:54.119637 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-30ce046a-5f9c-41d6-99d7-45038270eb28 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:54.120418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-30ce046a-5f9c-41d6-99d7-45038270eb28 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:54.120859 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-30ce046a-5f9c-41d6-99d7-45038270eb28 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:54.145151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-30ce046a-5f9c-41d6-99d7-45038270eb28 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d/ips" status: 200 len: 152 microversion: 2.20 time: 0.039760 Jul 28 04:09:54.145738 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 528/994] 10.222.0.46 () {60 vars in 1289 bytes} [Thu Jul 28 04:09:54 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:09:55.926455 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=42,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:55.927228 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:09:55.931926 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-d21753f9-e4c0-46c4-8848-ca8a4e285caf tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:09:55.932464 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-d21753f9-e4c0-46c4-8848-ca8a4e285caf tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:55.939688 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d21753f9-e4c0-46c4-8848-ca8a4e285caf tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:55.940153 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d21753f9-e4c0-46c4-8848-ca8a4e285caf tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:55.940921 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d21753f9-e4c0-46c4-8848-ca8a4e285caf tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:55.941357 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d21753f9-e4c0-46c4-8848-ca8a4e285caf tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:55.964843 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.objects.instance [None req-d21753f9-e4c0-46c4-8848-ca8a4e285caf tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lazy-loading 'flavor' on Instance uuid 7b67751f-bbbc-48cc-9286-3312b89f746d {{(pid=118186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:09:56.139216 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-d21753f9-e4c0-46c4-8848-ca8a4e285caf tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "POST /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d/action" status: 202 len: 0 microversion: 2.20 time: 0.213902 Jul 28 04:09:56.139803 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 467/995] 10.222.0.46 () {62 vars in 1319 bytes} [Thu Jul 28 04:09:55 2022] POST /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d/action => generated 0 bytes in 215 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 28 04:09:56.148747 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c1e67546-57b0-4699-b34c-52ae1e207236 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:56.149368 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c1e67546-57b0-4699-b34c-52ae1e207236 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:56.156685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c1e67546-57b0-4699-b34c-52ae1e207236 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:56.157386 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c1e67546-57b0-4699-b34c-52ae1e207236 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:56.158142 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c1e67546-57b0-4699-b34c-52ae1e207236 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:56.158590 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c1e67546-57b0-4699-b34c-52ae1e207236 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:56.490904 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c1e67546-57b0-4699-b34c-52ae1e207236 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:56.498744 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c1e67546-57b0-4699-b34c-52ae1e207236 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:56.500479 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c1e67546-57b0-4699-b34c-52ae1e207236 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:56.501642 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c1e67546-57b0-4699-b34c-52ae1e207236 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1724 microversion: 2.20 time: 0.356782 Jul 28 04:09:56.502201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 529/996] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:09:56 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1724 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:09:57.525499 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-04c35958-02c7-4435-9741-fb599609927d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:57.526190 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-04c35958-02c7-4435-9741-fb599609927d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:57.534426 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-04c35958-02c7-4435-9741-fb599609927d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:57.534895 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-04c35958-02c7-4435-9741-fb599609927d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:57.535667 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-04c35958-02c7-4435-9741-fb599609927d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:57.536096 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-04c35958-02c7-4435-9741-fb599609927d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:57.666118 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-04c35958-02c7-4435-9741-fb599609927d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:57.674807 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-04c35958-02c7-4435-9741-fb599609927d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:57.676321 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-04c35958-02c7-4435-9741-fb599609927d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:57.677478 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-04c35958-02c7-4435-9741-fb599609927d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1724 microversion: 2.20 time: 0.156811 Jul 28 04:09:57.678024 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 468/997] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:09:57 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:09:58.700121 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-230c8a8c-25ea-44c2-b910-82447fad45d9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:58.700737 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-230c8a8c-25ea-44c2-b910-82447fad45d9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:58.708273 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-230c8a8c-25ea-44c2-b910-82447fad45d9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:58.708723 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-230c8a8c-25ea-44c2-b910-82447fad45d9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:58.709488 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-230c8a8c-25ea-44c2-b910-82447fad45d9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:58.709928 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-230c8a8c-25ea-44c2-b910-82447fad45d9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:58.840310 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-230c8a8c-25ea-44c2-b910-82447fad45d9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:58.849107 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-230c8a8c-25ea-44c2-b910-82447fad45d9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:58.850617 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-230c8a8c-25ea-44c2-b910-82447fad45d9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:09:58.851807 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-230c8a8c-25ea-44c2-b910-82447fad45d9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1724 microversion: 2.20 time: 0.155683 Jul 28 04:09:58.852358 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 530/998] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:09:58 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:09:59.874236 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-228a64b5-6595-43df-83d3-5dfce1acc734 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:09:59.874884 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-228a64b5-6595-43df-83d3-5dfce1acc734 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:09:59.881659 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-228a64b5-6595-43df-83d3-5dfce1acc734 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:59.882116 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-228a64b5-6595-43df-83d3-5dfce1acc734 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:09:59.882911 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-228a64b5-6595-43df-83d3-5dfce1acc734 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:09:59.883346 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-228a64b5-6595-43df-83d3-5dfce1acc734 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:00.015877 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-228a64b5-6595-43df-83d3-5dfce1acc734 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:00.023779 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-228a64b5-6595-43df-83d3-5dfce1acc734 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:00.025289 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-228a64b5-6595-43df-83d3-5dfce1acc734 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:00.026475 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-228a64b5-6595-43df-83d3-5dfce1acc734 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1724 microversion: 2.20 time: 0.156157 Jul 28 04:10:00.027064 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 469/999] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:09:59 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:10:01.050832 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-0e721a5b-5134-462e-b2c5-00637559ae83 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:01.051458 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-0e721a5b-5134-462e-b2c5-00637559ae83 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:01.057933 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0e721a5b-5134-462e-b2c5-00637559ae83 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:01.058383 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0e721a5b-5134-462e-b2c5-00637559ae83 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:01.059173 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0e721a5b-5134-462e-b2c5-00637559ae83 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:01.059608 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0e721a5b-5134-462e-b2c5-00637559ae83 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:01.187498 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-0e721a5b-5134-462e-b2c5-00637559ae83 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:01.196225 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-0e721a5b-5134-462e-b2c5-00637559ae83 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:01.197746 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-0e721a5b-5134-462e-b2c5-00637559ae83 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:01.198945 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-0e721a5b-5134-462e-b2c5-00637559ae83 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1724 microversion: 2.20 time: 0.153047 Jul 28 04:10:01.199514 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 531/1000] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:01 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:02.222004 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-bc5e581b-0c60-4b07-b372-19dd79d7b4c0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:02.222613 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-bc5e581b-0c60-4b07-b372-19dd79d7b4c0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:02.229073 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bc5e581b-0c60-4b07-b372-19dd79d7b4c0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:02.229515 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bc5e581b-0c60-4b07-b372-19dd79d7b4c0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:02.230263 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bc5e581b-0c60-4b07-b372-19dd79d7b4c0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:02.230692 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-bc5e581b-0c60-4b07-b372-19dd79d7b4c0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:02.358578 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-bc5e581b-0c60-4b07-b372-19dd79d7b4c0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:02.366853 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-bc5e581b-0c60-4b07-b372-19dd79d7b4c0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:02.368351 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-bc5e581b-0c60-4b07-b372-19dd79d7b4c0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:02.369503 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-bc5e581b-0c60-4b07-b372-19dd79d7b4c0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1724 microversion: 2.20 time: 0.151637 Jul 28 04:10:02.370055 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 470/1001] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:02 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:03.393876 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-871081c8-e6d3-4d9f-9883-549c6897d8dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:03.394490 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-871081c8-e6d3-4d9f-9883-549c6897d8dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:03.401085 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-871081c8-e6d3-4d9f-9883-549c6897d8dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:03.401539 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-871081c8-e6d3-4d9f-9883-549c6897d8dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:03.402311 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-871081c8-e6d3-4d9f-9883-549c6897d8dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:03.402748 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-871081c8-e6d3-4d9f-9883-549c6897d8dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:03.531158 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-871081c8-e6d3-4d9f-9883-549c6897d8dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:03.540341 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-871081c8-e6d3-4d9f-9883-549c6897d8dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:03.541855 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-871081c8-e6d3-4d9f-9883-549c6897d8dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:03.543050 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-871081c8-e6d3-4d9f-9883-549c6897d8dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1724 microversion: 2.20 time: 0.153338 Jul 28 04:10:03.543601 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 532/1002] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:03 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:04.567453 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-938c726b-f548-42f9-9ea7-2573b2e196dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:04.568067 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-938c726b-f548-42f9-9ea7-2573b2e196dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:04.574511 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-938c726b-f548-42f9-9ea7-2573b2e196dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:04.574998 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-938c726b-f548-42f9-9ea7-2573b2e196dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:04.575788 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-938c726b-f548-42f9-9ea7-2573b2e196dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:04.576223 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-938c726b-f548-42f9-9ea7-2573b2e196dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:04.707365 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-938c726b-f548-42f9-9ea7-2573b2e196dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:04.715264 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-938c726b-f548-42f9-9ea7-2573b2e196dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:04.716781 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-938c726b-f548-42f9-9ea7-2573b2e196dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:04.717950 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-938c726b-f548-42f9-9ea7-2573b2e196dc tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1724 microversion: 2.20 time: 0.155351 Jul 28 04:10:04.718520 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 471/1003] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:04 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:05.741366 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-493c7a40-b40d-4e1b-a016-42a9272a3074 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:05.742095 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-493c7a40-b40d-4e1b-a016-42a9272a3074 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:05.748906 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-493c7a40-b40d-4e1b-a016-42a9272a3074 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:05.749358 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-493c7a40-b40d-4e1b-a016-42a9272a3074 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:05.750127 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-493c7a40-b40d-4e1b-a016-42a9272a3074 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:05.750564 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-493c7a40-b40d-4e1b-a016-42a9272a3074 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:06.183468 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-493c7a40-b40d-4e1b-a016-42a9272a3074 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:06.192204 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-493c7a40-b40d-4e1b-a016-42a9272a3074 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:06.193726 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-493c7a40-b40d-4e1b-a016-42a9272a3074 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:06.194935 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-493c7a40-b40d-4e1b-a016-42a9272a3074 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1724 microversion: 2.20 time: 0.457593 Jul 28 04:10:06.195500 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 533/1004] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:05 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1724 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:06.327175 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-17b242ab-cd28-4dcd-bc9e-0709579c9a89 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:06.327668 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-17b242ab-cd28-4dcd-bc9e-0709579c9a89 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: c4141dc5-3852-4a32-8072-3d64fea68419] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:06.330349 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-5f71deb1-1bd8-4457-8e43-70873a6f3577 req-6e67392e-5349-4dde-b4d1-964c074f0fb2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c4141dc5-3852-4a32-8072-3d64fea68419", "tag": "a5e40ccf-c969-45d7-8270-1b6624bac045"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:06.335317 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-17b242ab-cd28-4dcd-bc9e-0709579c9a89 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:06.336069 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-17b242ab-cd28-4dcd-bc9e-0709579c9a89 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:06.336902 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-17b242ab-cd28-4dcd-bc9e-0709579c9a89 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:06.337403 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-17b242ab-cd28-4dcd-bc9e-0709579c9a89 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:06.340175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-5f71deb1-1bd8-4457-8e43-70873a6f3577 req-6e67392e-5349-4dde-b4d1-964c074f0fb2 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:06.340625 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-5f71deb1-1bd8-4457-8e43-70873a6f3577 req-6e67392e-5349-4dde-b4d1-964c074f0fb2 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:06.352888 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-5f71deb1-1bd8-4457-8e43-70873a6f3577 req-6e67392e-5349-4dde-b4d1-964c074f0fb2 service nova] Creating event network-changed:a5e40ccf-c969-45d7-8270-1b6624bac045 for instance c4141dc5-3852-4a32-8072-3d64fea68419 on hv-cinder-79987 Jul 28 04:10:06.358453 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-5f71deb1-1bd8-4457-8e43-70873a6f3577 req-6e67392e-5349-4dde-b4d1-964c074f0fb2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032792 Jul 28 04:10:06.359450 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 534/1005] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:10:06.363797 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-17b242ab-cd28-4dcd-bc9e-0709579c9a89 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: c4141dc5-3852-4a32-8072-3d64fea68419] Going to try to terminate instance {{(pid=118186) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:10:06.451296 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-17b242ab-cd28-4dcd-bc9e-0709579c9a89 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "DELETE /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419" status: 204 len: 0 microversion: 2.1 time: 0.127525 Jul 28 04:10:06.452201 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 472/1006] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:10:06 2022] DELETE /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:10:06.472507 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-0b68aeba-f1aa-4627-a56a-536038cdf6fc tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:06.473238 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-0b68aeba-f1aa-4627-a56a-536038cdf6fc tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: c4141dc5-3852-4a32-8072-3d64fea68419] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:06.479756 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0b68aeba-f1aa-4627-a56a-536038cdf6fc tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:06.480220 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0b68aeba-f1aa-4627-a56a-536038cdf6fc tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:06.481009 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0b68aeba-f1aa-4627-a56a-536038cdf6fc tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:06.481450 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-0b68aeba-f1aa-4627-a56a-536038cdf6fc tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:06.618451 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-0b68aeba-f1aa-4627-a56a-536038cdf6fc tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:06.628256 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-0b68aeba-f1aa-4627-a56a-536038cdf6fc tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419" status: 200 len: 1578 microversion: 2.1 time: 0.168145 Jul 28 04:10:06.628945 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 535/1007] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:06 2022] GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419 => generated 1578 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:07.218222 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-068cfd84-9b19-4543-bc61-57daa9163bfd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:07.218966 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-068cfd84-9b19-4543-bc61-57daa9163bfd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:07.225259 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-068cfd84-9b19-4543-bc61-57daa9163bfd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:07.225882 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-068cfd84-9b19-4543-bc61-57daa9163bfd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:07.226479 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-068cfd84-9b19-4543-bc61-57daa9163bfd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:07.226985 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-068cfd84-9b19-4543-bc61-57daa9163bfd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:07.361627 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-068cfd84-9b19-4543-bc61-57daa9163bfd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:07.369590 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-068cfd84-9b19-4543-bc61-57daa9163bfd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:07.371138 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-068cfd84-9b19-4543-bc61-57daa9163bfd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:07.372311 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-068cfd84-9b19-4543-bc61-57daa9163bfd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1724 microversion: 2.20 time: 0.158502 Jul 28 04:10:07.372871 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 473/1008] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:07 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:07.652309 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-38e71069-ce37-4cab-84f2-8a71306e04a7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:07.653036 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-38e71069-ce37-4cab-84f2-8a71306e04a7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: c4141dc5-3852-4a32-8072-3d64fea68419] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:07.660291 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-38e71069-ce37-4cab-84f2-8a71306e04a7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:07.660741 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-38e71069-ce37-4cab-84f2-8a71306e04a7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:07.661505 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-38e71069-ce37-4cab-84f2-8a71306e04a7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:07.661946 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-38e71069-ce37-4cab-84f2-8a71306e04a7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:07.795596 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-38e71069-ce37-4cab-84f2-8a71306e04a7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:07.803884 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-38e71069-ce37-4cab-84f2-8a71306e04a7 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419" status: 200 len: 1578 microversion: 2.1 time: 0.157540 Jul 28 04:10:07.804589 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 536/1009] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:07 2022] GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419 => generated 1578 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:08.397864 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-18b48b7c-7de4-45fb-9c2d-c7574fa8cb55 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:08.398485 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-18b48b7c-7de4-45fb-9c2d-c7574fa8cb55 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:08.405042 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-18b48b7c-7de4-45fb-9c2d-c7574fa8cb55 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:08.405491 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-18b48b7c-7de4-45fb-9c2d-c7574fa8cb55 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:08.406251 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-18b48b7c-7de4-45fb-9c2d-c7574fa8cb55 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:08.406684 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-18b48b7c-7de4-45fb-9c2d-c7574fa8cb55 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:08.648431 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-18b48b7c-7de4-45fb-9c2d-c7574fa8cb55 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:08.656440 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-18b48b7c-7de4-45fb-9c2d-c7574fa8cb55 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:08.657986 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-18b48b7c-7de4-45fb-9c2d-c7574fa8cb55 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:08.659329 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-18b48b7c-7de4-45fb-9c2d-c7574fa8cb55 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1724 microversion: 2.20 time: 0.265388 Jul 28 04:10:08.659892 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 474/1010] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:08 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1724 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:08.825503 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-7c6c3c10-ea90-44a8-93a2-eccadd9d9c79 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:08.826150 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-7c6c3c10-ea90-44a8-93a2-eccadd9d9c79 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: c4141dc5-3852-4a32-8072-3d64fea68419] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:08.832946 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7c6c3c10-ea90-44a8-93a2-eccadd9d9c79 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:08.833393 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7c6c3c10-ea90-44a8-93a2-eccadd9d9c79 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:08.834174 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7c6c3c10-ea90-44a8-93a2-eccadd9d9c79 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:08.834609 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-7c6c3c10-ea90-44a8-93a2-eccadd9d9c79 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:08.902426 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-7c6c3c10-ea90-44a8-93a2-eccadd9d9c79 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:08.913943 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-7c6c3c10-ea90-44a8-93a2-eccadd9d9c79 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419" status: 200 len: 1393 microversion: 2.1 time: 0.091256 Jul 28 04:10:08.914766 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 537/1011] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:08 2022] GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419 => generated 1393 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:08.964487 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-396f249e-e749-47f9-a3c7-7ebe028cda1f req-d7c328eb-6bff-4491-8db0-adf68fff068c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c4141dc5-3852-4a32-8072-3d64fea68419", "name": "network-vif-deleted", "tag": "a5e40ccf-c969-45d7-8270-1b6624bac045"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:08.974948 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-396f249e-e749-47f9-a3c7-7ebe028cda1f req-d7c328eb-6bff-4491-8db0-adf68fff068c service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:08.975448 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-396f249e-e749-47f9-a3c7-7ebe028cda1f req-d7c328eb-6bff-4491-8db0-adf68fff068c service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:09.133864 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-396f249e-e749-47f9-a3c7-7ebe028cda1f req-d7c328eb-6bff-4491-8db0-adf68fff068c service nova] Creating event network-vif-deleted:a5e40ccf-c969-45d7-8270-1b6624bac045 for instance c4141dc5-3852-4a32-8072-3d64fea68419 on hv-cinder-79987 Jul 28 04:10:09.138391 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-396f249e-e749-47f9-a3c7-7ebe028cda1f req-d7c328eb-6bff-4491-8db0-adf68fff068c service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.239917 Jul 28 04:10:09.139238 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 475/1012] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:10:09.684805 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d1e237f3-7823-4ad3-ba2e-a665a1883bf4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:09.685612 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d1e237f3-7823-4ad3-ba2e-a665a1883bf4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:09.693348 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d1e237f3-7823-4ad3-ba2e-a665a1883bf4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:09.693798 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d1e237f3-7823-4ad3-ba2e-a665a1883bf4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:09.694572 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d1e237f3-7823-4ad3-ba2e-a665a1883bf4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:09.695050 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d1e237f3-7823-4ad3-ba2e-a665a1883bf4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:09.829005 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d1e237f3-7823-4ad3-ba2e-a665a1883bf4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:09.837421 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d1e237f3-7823-4ad3-ba2e-a665a1883bf4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:09.838937 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-d1e237f3-7823-4ad3-ba2e-a665a1883bf4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:09.840088 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d1e237f3-7823-4ad3-ba2e-a665a1883bf4 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1724 microversion: 2.20 time: 0.160851 Jul 28 04:10:09.840639 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 538/1013] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:09 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:09.937528 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-15c65a71-2197-48e5-9165-737d5be4d7cf tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:09.938222 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-15c65a71-2197-48e5-9165-737d5be4d7cf tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: c4141dc5-3852-4a32-8072-3d64fea68419] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:09.944649 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-15c65a71-2197-48e5-9165-737d5be4d7cf tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:09.945094 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-15c65a71-2197-48e5-9165-737d5be4d7cf tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:09.945842 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-15c65a71-2197-48e5-9165-737d5be4d7cf tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:09.946272 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-15c65a71-2197-48e5-9165-737d5be4d7cf tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:09.959653 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.wsgi [None req-15c65a71-2197-48e5-9165-737d5be4d7cf tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] HTTP exception thrown: Instance c4141dc5-3852-4a32-8072-3d64fea68419 could not be found. Jul 28 04:10:09.961275 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-15c65a71-2197-48e5-9165-737d5be4d7cf tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Request method failure captured: Jul 28 04:10:09.961275 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: request: GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419 HTTP/1.1 Jul 28 04:10:09.961275 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept: application/json Jul 28 04:10:09.961275 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept-Encoding: identity Jul 28 04:10:09.961275 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Connection: close Jul 28 04:10:09.961275 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Length: 0 Jul 28 04:10:09.961275 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Type: application/json Jul 28 04:10:09.961275 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Host: 10.222.0.46 Jul 28 04:10:09.961275 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Openstack-System-Scope: None Jul 28 04:10:09.961275 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: User-Agent: python-urllib3/1.26.10 Jul 28 04:10:09.961275 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Auth-Token: gAAAAABi4gpzwOklwNPcAxBHZOI1ssvbTDgevywfPDg1yEt0tUb4vs9CGIW1HscS9ZkGWtQaBkjtwjYHRZPMEfCBroYl-luuwuhVsCRgo82EETIhmv-q8utzHf0HSy0tMariOS19fBjcoglWOQOMyj-zi_XUYhE5beKJEpg4A_NllVniOatsHmc Jul 28 04:10:09.961275 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Id: None Jul 28 04:10:09.961275 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Name: None Jul 28 04:10:09.961275 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Identity-Status: Confirmed Jul 28 04:10:09.961275 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Is-Admin-Project: True Jul 28 04:10:09.961275 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Id: default Jul 28 04:10:09.961275 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Name: Default Jul 28 04:10:09.961275 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Id: 338679f381ed4e9e898a59289b0f8178 Jul 28 04:10:09.961275 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Name: tempest-TestVolumeBootPattern-143181242 Jul 28 04:10:09.961275 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Role: reader,member Jul 28 04:10:09.961275 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Roles: reader,member Jul 28 04:10:09.962998 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_338679f381ed4e9e898a59289b0f8178", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/338679f381ed4e9e898a59289b0f8178"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/338679f381ed4e9e898a59289b0f8178"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/338679f381ed4e9e898a59289b0f8178"}]}] Jul 28 04:10:09.962998 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant: tempest-TestVolumeBootPattern-143181242 Jul 28 04:10:09.962998 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Id: 338679f381ed4e9e898a59289b0f8178 Jul 28 04:10:09.962998 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Name: tempest-TestVolumeBootPattern-143181242 Jul 28 04:10:09.962998 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User: tempest-TestVolumeBootPattern-143181242-project Jul 28 04:10:09.962998 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Id: default Jul 28 04:10:09.962998 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Name: Default Jul 28 04:10:09.962998 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Id: 352d60372ba249e38ea4aa2d62723f19 Jul 28 04:10:09.962998 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Name: tempest-TestVolumeBootPattern-143181242-project Jul 28 04:10:09.962998 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: method: > Jul 28 04:10:09.962998 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: exception: Instance c4141dc5-3852-4a32-8072-3d64fea68419 could not be found. Jul 28 04:10:09.962998 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: action_args: {'id': 'c4141dc5-3852-4a32-8072-3d64fea68419'} Jul 28 04:10:09.964100 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:10:09.964100 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:10:09.964100 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:10:09.964100 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:10:09.964100 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:10:09.964100 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:10:09.964100 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:10:09.964100 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:10:09.964100 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:10:09.964100 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:10:09.964100 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c4141dc5-3852-4a32-8072-3d64fea68419 could not be found. Jul 28 04:10:09.964100 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:10:09.964100 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:10:09.964100 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:10:09.964100 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:10:09.964100 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:10:09.964100 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:10:09.964100 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:10:09.964100 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:10:09.964100 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:10:09.965718 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:10:09.965718 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:10:09.965718 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:10:09.965718 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:10:09.965718 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:10:09.965718 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:10:09.965718 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:10:09.965718 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c4141dc5-3852-4a32-8072-3d64fea68419 could not be found. Jul 28 04:10:09.965718 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:10:09.965718 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:10:09.965718 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:10:09.965718 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:10:09.965718 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:10:09.965718 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:10:09.965718 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:10:09.965718 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:10:09.965718 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c4141dc5-3852-4a32-8072-3d64fea68419 could not be found. Jul 28 04:10:09.965718 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:10:09.967341 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-15c65a71-2197-48e5-9165-737d5be4d7cf tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Returning 404 to user: Instance c4141dc5-3852-4a32-8072-3d64fea68419 could not be found. {{(pid=118186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:10:09.967341 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-15c65a71-2197-48e5-9165-737d5be4d7cf tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419" status: 404 len: 111 microversion: 2.1 time: 0.029775 Jul 28 04:10:09.967341 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 476/1014] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:09 2022] GET /compute/v2.1/servers/c4141dc5-3852-4a32-8072-3d64fea68419 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:10:10.862476 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-54b70ed1-033f-471c-9925-4004e4739ad9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:10.863810 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-54b70ed1-033f-471c-9925-4004e4739ad9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:10.870344 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-54b70ed1-033f-471c-9925-4004e4739ad9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:10.870803 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-54b70ed1-033f-471c-9925-4004e4739ad9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:10.871577 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-54b70ed1-033f-471c-9925-4004e4739ad9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:10.872009 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-54b70ed1-033f-471c-9925-4004e4739ad9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:11.001070 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-54b70ed1-033f-471c-9925-4004e4739ad9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:11.009831 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-54b70ed1-033f-471c-9925-4004e4739ad9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:11.011402 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-54b70ed1-033f-471c-9925-4004e4739ad9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:11.012576 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-54b70ed1-033f-471c-9925-4004e4739ad9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1724 microversion: 2.20 time: 0.154010 Jul 28 04:10:11.013133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 539/1015] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:10 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:12.035629 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-2fe87ff0-3316-4ab8-a048-be133585e9b2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:12.036249 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-2fe87ff0-3316-4ab8-a048-be133585e9b2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:12.043008 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2fe87ff0-3316-4ab8-a048-be133585e9b2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:12.043471 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2fe87ff0-3316-4ab8-a048-be133585e9b2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:12.044241 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2fe87ff0-3316-4ab8-a048-be133585e9b2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:12.044682 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2fe87ff0-3316-4ab8-a048-be133585e9b2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:12.177928 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-2fe87ff0-3316-4ab8-a048-be133585e9b2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:12.186053 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-2fe87ff0-3316-4ab8-a048-be133585e9b2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:12.187612 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-2fe87ff0-3316-4ab8-a048-be133585e9b2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:12.188814 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-2fe87ff0-3316-4ab8-a048-be133585e9b2 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1724 microversion: 2.20 time: 0.157844 Jul 28 04:10:12.189472 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 477/1016] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:12 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:13.006477 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-84e1eec0-bb19-49f3-b819-1dc4d1ac7939 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:13.007018 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-84e1eec0-bb19-49f3-b819-1dc4d1ac7939 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 042cba62-5323-4dd0-9ad7-92ec0f0746c5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:13.009351 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-b6abf28a-e497-4ee6-8f05-d6b2371915eb req-ce663427-f77d-4dec-9ea1-79b3aef09cbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "042cba62-5323-4dd0-9ad7-92ec0f0746c5", "tag": "9433ba71-4c92-4e59-94cf-c5886d010db8"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:13.013665 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-84e1eec0-bb19-49f3-b819-1dc4d1ac7939 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:13.014119 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-84e1eec0-bb19-49f3-b819-1dc4d1ac7939 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:13.015299 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-84e1eec0-bb19-49f3-b819-1dc4d1ac7939 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:13.015747 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-84e1eec0-bb19-49f3-b819-1dc4d1ac7939 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:13.020074 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-b6abf28a-e497-4ee6-8f05-d6b2371915eb req-ce663427-f77d-4dec-9ea1-79b3aef09cbc service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:13.020532 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-b6abf28a-e497-4ee6-8f05-d6b2371915eb req-ce663427-f77d-4dec-9ea1-79b3aef09cbc service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:13.031651 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-b6abf28a-e497-4ee6-8f05-d6b2371915eb req-ce663427-f77d-4dec-9ea1-79b3aef09cbc service nova] Creating event network-changed:9433ba71-4c92-4e59-94cf-c5886d010db8 for instance 042cba62-5323-4dd0-9ad7-92ec0f0746c5 on hv-cinder-79987 Jul 28 04:10:13.037548 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-b6abf28a-e497-4ee6-8f05-d6b2371915eb req-ce663427-f77d-4dec-9ea1-79b3aef09cbc service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032102 Jul 28 04:10:13.038775 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 478/1017] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:10:13.046421 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-84e1eec0-bb19-49f3-b819-1dc4d1ac7939 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 042cba62-5323-4dd0-9ad7-92ec0f0746c5] Going to try to terminate instance {{(pid=118187) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:10:13.134205 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-84e1eec0-bb19-49f3-b819-1dc4d1ac7939 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "DELETE /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5" status: 204 len: 0 microversion: 2.1 time: 0.132207 Jul 28 04:10:13.134826 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 540/1018] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:10:13 2022] DELETE /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:10:13.146173 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-95726bb5-76ed-476f-82f0-e4bc532d3191 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:13.146951 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-95726bb5-76ed-476f-82f0-e4bc532d3191 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 042cba62-5323-4dd0-9ad7-92ec0f0746c5] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:13.156072 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-95726bb5-76ed-476f-82f0-e4bc532d3191 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:13.156788 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-95726bb5-76ed-476f-82f0-e4bc532d3191 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:13.158354 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-95726bb5-76ed-476f-82f0-e4bc532d3191 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:13.158987 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-95726bb5-76ed-476f-82f0-e4bc532d3191 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:13.212513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-03f0b51e-3f6c-4e48-be75-2d0c60b012a7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:13.213208 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-03f0b51e-3f6c-4e48-be75-2d0c60b012a7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:13.221169 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-03f0b51e-3f6c-4e48-be75-2d0c60b012a7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:13.221619 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-03f0b51e-3f6c-4e48-be75-2d0c60b012a7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:13.222392 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-03f0b51e-3f6c-4e48-be75-2d0c60b012a7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:13.222862 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-03f0b51e-3f6c-4e48-be75-2d0c60b012a7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:13.316779 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-95726bb5-76ed-476f-82f0-e4bc532d3191 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:13.325335 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-95726bb5-76ed-476f-82f0-e4bc532d3191 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5" status: 200 len: 1577 microversion: 2.1 time: 0.185564 Jul 28 04:10:13.325919 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 479/1019] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:13 2022] GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5 => generated 1577 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:13.361269 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-03f0b51e-3f6c-4e48-be75-2d0c60b012a7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:13.370392 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-03f0b51e-3f6c-4e48-be75-2d0c60b012a7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:13.371950 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-03f0b51e-3f6c-4e48-be75-2d0c60b012a7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:13.373132 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-03f0b51e-3f6c-4e48-be75-2d0c60b012a7 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1724 microversion: 2.20 time: 0.164865 Jul 28 04:10:13.373687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 541/1020] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:13 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:10:14.347359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-2d370d75-cfb7-460f-876b-ed10563f3d24 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:14.347899 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-2d370d75-cfb7-460f-876b-ed10563f3d24 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 042cba62-5323-4dd0-9ad7-92ec0f0746c5] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:14.354544 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2d370d75-cfb7-460f-876b-ed10563f3d24 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:14.355031 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2d370d75-cfb7-460f-876b-ed10563f3d24 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:14.355791 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2d370d75-cfb7-460f-876b-ed10563f3d24 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:14.356221 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2d370d75-cfb7-460f-876b-ed10563f3d24 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:14.398054 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b896eae4-137e-4b57-baed-f47b1b3444ad tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:14.398770 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b896eae4-137e-4b57-baed-f47b1b3444ad tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:14.405584 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b896eae4-137e-4b57-baed-f47b1b3444ad tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:14.406031 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b896eae4-137e-4b57-baed-f47b1b3444ad tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:14.406817 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b896eae4-137e-4b57-baed-f47b1b3444ad tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:14.407258 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b896eae4-137e-4b57-baed-f47b1b3444ad tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:14.543445 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b896eae4-137e-4b57-baed-f47b1b3444ad tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:14.551831 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b896eae4-137e-4b57-baed-f47b1b3444ad tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:14.553423 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b896eae4-137e-4b57-baed-f47b1b3444ad tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:14.554613 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b896eae4-137e-4b57-baed-f47b1b3444ad tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1724 microversion: 2.20 time: 0.160453 Jul 28 04:10:14.555208 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 542/1021] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:14 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:10:14.571401 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-2d370d75-cfb7-460f-876b-ed10563f3d24 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:14.578863 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-2d370d75-cfb7-460f-876b-ed10563f3d24 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5" status: 200 len: 1577 microversion: 2.1 time: 0.236083 Jul 28 04:10:14.579990 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 480/1022] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:14 2022] GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5 => generated 1577 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:10:15.128664 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-2fdf4868-f601-48e5-beef-b10a5ee89bfb req-56ced660-e0c7-49c9-8dd6-bca24541d4b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "042cba62-5323-4dd0-9ad7-92ec0f0746c5", "name": "network-vif-deleted", "tag": "9433ba71-4c92-4e59-94cf-c5886d010db8"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:15.139745 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-2fdf4868-f601-48e5-beef-b10a5ee89bfb req-56ced660-e0c7-49c9-8dd6-bca24541d4b4 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:15.140201 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-2fdf4868-f601-48e5-beef-b10a5ee89bfb req-56ced660-e0c7-49c9-8dd6-bca24541d4b4 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:15.153462 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-2fdf4868-f601-48e5-beef-b10a5ee89bfb req-56ced660-e0c7-49c9-8dd6-bca24541d4b4 service nova] Creating event network-vif-deleted:9433ba71-4c92-4e59-94cf-c5886d010db8 for instance 042cba62-5323-4dd0-9ad7-92ec0f0746c5 on hv-cinder-79987 Jul 28 04:10:15.158530 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-2fdf4868-f601-48e5-beef-b10a5ee89bfb req-56ced660-e0c7-49c9-8dd6-bca24541d4b4 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034409 Jul 28 04:10:15.159178 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 543/1023] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:10:15.577627 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a1e20841-02c8-4595-b4eb-5334df796916 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:15.578174 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-a1e20841-02c8-4595-b4eb-5334df796916 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:15.584806 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a1e20841-02c8-4595-b4eb-5334df796916 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:15.585267 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a1e20841-02c8-4595-b4eb-5334df796916 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:15.586006 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a1e20841-02c8-4595-b4eb-5334df796916 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:15.586438 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a1e20841-02c8-4595-b4eb-5334df796916 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:15.602272 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-66ddb882-9e3a-40dd-9d6d-7e536dbc004f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:15.603130 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-66ddb882-9e3a-40dd-9d6d-7e536dbc004f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 042cba62-5323-4dd0-9ad7-92ec0f0746c5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:15.609434 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-66ddb882-9e3a-40dd-9d6d-7e536dbc004f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:15.609891 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-66ddb882-9e3a-40dd-9d6d-7e536dbc004f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:15.611375 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-66ddb882-9e3a-40dd-9d6d-7e536dbc004f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:15.611787 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-66ddb882-9e3a-40dd-9d6d-7e536dbc004f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:15.636452 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:15.652511 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-66ddb882-9e3a-40dd-9d6d-7e536dbc004f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:15.652710 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-66ddb882-9e3a-40dd-9d6d-7e536dbc004f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:15.653037 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.objects.instance [None req-66ddb882-9e3a-40dd-9d6d-7e536dbc004f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lazy-loading 'fault' on Instance uuid 042cba62-5323-4dd0-9ad7-92ec0f0746c5 {{(pid=118187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:10:15.703744 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-66ddb882-9e3a-40dd-9d6d-7e536dbc004f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '352d60372ba249e38ea4aa2d62723f19', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '338679f381ed4e9e898a59289b0f8178', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:15.712142 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-66ddb882-9e3a-40dd-9d6d-7e536dbc004f tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5" status: 200 len: 1231 microversion: 2.1 time: 0.114477 Jul 28 04:10:15.712861 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 544/1024] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:15 2022] GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5 => generated 1231 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:10:15.733906 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-a1e20841-02c8-4595-b4eb-5334df796916 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:15.737980 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:15.743327 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-a1e20841-02c8-4595-b4eb-5334df796916 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:15.744839 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-a1e20841-02c8-4595-b4eb-5334df796916 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:15.746061 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-a1e20841-02c8-4595-b4eb-5334df796916 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1724 microversion: 2.20 time: 0.172452 Jul 28 04:10:15.746714 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 481/1025] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:15 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:16.736180 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-af745b77-b6e1-4a64-84d5-d34ad0e8b365 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:16.736754 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-af745b77-b6e1-4a64-84d5-d34ad0e8b365 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 042cba62-5323-4dd0-9ad7-92ec0f0746c5] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:16.743419 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-af745b77-b6e1-4a64-84d5-d34ad0e8b365 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:16.743870 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-af745b77-b6e1-4a64-84d5-d34ad0e8b365 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:16.744634 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-af745b77-b6e1-4a64-84d5-d34ad0e8b365 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:16.745072 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-af745b77-b6e1-4a64-84d5-d34ad0e8b365 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:16.760858 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-af745b77-b6e1-4a64-84d5-d34ad0e8b365 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] HTTP exception thrown: Instance 042cba62-5323-4dd0-9ad7-92ec0f0746c5 could not be found. Jul 28 04:10:16.762486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-af745b77-b6e1-4a64-84d5-d34ad0e8b365 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Request method failure captured: Jul 28 04:10:16.762486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5 HTTP/1.1 Jul 28 04:10:16.762486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:10:16.762486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:10:16.762486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:10:16.762486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:10:16.762486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:10:16.762486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:10:16.762486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:10:16.762486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:10:16.762486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gpzwOklwNPcAxBHZOI1ssvbTDgevywfPDg1yEt0tUb4vs9CGIW1HscS9ZkGWtQaBkjtwjYHRZPMEfCBroYl-luuwuhVsCRgo82EETIhmv-q8utzHf0HSy0tMariOS19fBjcoglWOQOMyj-zi_XUYhE5beKJEpg4A_NllVniOatsHmc Jul 28 04:10:16.762486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:10:16.762486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:10:16.762486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:10:16.762486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:10:16.762486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:10:16.762486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:10:16.762486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 338679f381ed4e9e898a59289b0f8178 Jul 28 04:10:16.762486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-TestVolumeBootPattern-143181242 Jul 28 04:10:16.762486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:10:16.762486 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:10:16.764133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_338679f381ed4e9e898a59289b0f8178", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/338679f381ed4e9e898a59289b0f8178"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/338679f381ed4e9e898a59289b0f8178"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/338679f381ed4e9e898a59289b0f8178"}]}] Jul 28 04:10:16.764133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-TestVolumeBootPattern-143181242 Jul 28 04:10:16.764133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 338679f381ed4e9e898a59289b0f8178 Jul 28 04:10:16.764133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-TestVolumeBootPattern-143181242 Jul 28 04:10:16.764133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-TestVolumeBootPattern-143181242-project Jul 28 04:10:16.764133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:10:16.764133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:10:16.764133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: 352d60372ba249e38ea4aa2d62723f19 Jul 28 04:10:16.764133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-TestVolumeBootPattern-143181242-project Jul 28 04:10:16.764133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:10:16.764133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Instance 042cba62-5323-4dd0-9ad7-92ec0f0746c5 could not be found. Jul 28 04:10:16.764133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': '042cba62-5323-4dd0-9ad7-92ec0f0746c5'} Jul 28 04:10:16.765215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:10:16.765215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:10:16.765215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:10:16.765215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:10:16.765215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:10:16.765215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:10:16.765215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:10:16.765215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:10:16.765215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:10:16.765215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:10:16.765215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 042cba62-5323-4dd0-9ad7-92ec0f0746c5 could not be found. Jul 28 04:10:16.765215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:10:16.765215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:10:16.765215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:10:16.765215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:10:16.765215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:10:16.765215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:10:16.765215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:10:16.765215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:10:16.765215 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:10:16.767386 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:10:16.767386 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:10:16.767386 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:10:16.767386 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:10:16.767386 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:10:16.767386 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:10:16.767386 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:10:16.767386 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 042cba62-5323-4dd0-9ad7-92ec0f0746c5 could not be found. Jul 28 04:10:16.767386 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:10:16.767386 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:10:16.767386 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:10:16.767386 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:10:16.767386 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:10:16.767386 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:10:16.767386 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:10:16.767386 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:10:16.767386 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 042cba62-5323-4dd0-9ad7-92ec0f0746c5 could not be found. Jul 28 04:10:16.767386 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:10:16.769024 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-af745b77-b6e1-4a64-84d5-d34ad0e8b365 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Returning 404 to user: Instance 042cba62-5323-4dd0-9ad7-92ec0f0746c5 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:10:16.769024 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-af745b77-b6e1-4a64-84d5-d34ad0e8b365 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5" status: 404 len: 111 microversion: 2.1 time: 0.032296 Jul 28 04:10:16.769024 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 545/1026] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:16 2022] GET /compute/v2.1/servers/042cba62-5323-4dd0-9ad7-92ec0f0746c5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:10:16.777349 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a5c7e5a8-5af1-4d32-aac2-2287f1fa6575 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:16.777972 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-a5c7e5a8-5af1-4d32-aac2-2287f1fa6575 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:16.786621 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a5c7e5a8-5af1-4d32-aac2-2287f1fa6575 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:16.787115 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a5c7e5a8-5af1-4d32-aac2-2287f1fa6575 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:16.788151 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a5c7e5a8-5af1-4d32-aac2-2287f1fa6575 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:16.788594 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a5c7e5a8-5af1-4d32-aac2-2287f1fa6575 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:16.921522 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-a5c7e5a8-5af1-4d32-aac2-2287f1fa6575 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:16.930277 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-a5c7e5a8-5af1-4d32-aac2-2287f1fa6575 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:16.931806 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-a5c7e5a8-5af1-4d32-aac2-2287f1fa6575 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:16.932974 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-a5c7e5a8-5af1-4d32-aac2-2287f1fa6575 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1724 microversion: 2.20 time: 0.160326 Jul 28 04:10:16.933532 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 482/1027] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:16 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:17.200737 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b913af90-b1a8-4c0e-a5e9-497668abdcfd tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:17.201238 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b913af90-b1a8-4c0e-a5e9-497668abdcfd tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:17.207459 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b913af90-b1a8-4c0e-a5e9-497668abdcfd tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:17.207905 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b913af90-b1a8-4c0e-a5e9-497668abdcfd tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:17.208677 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b913af90-b1a8-4c0e-a5e9-497668abdcfd tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:17.209092 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b913af90-b1a8-4c0e-a5e9-497668abdcfd tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:17.222848 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-b913af90-b1a8-4c0e-a5e9-497668abdcfd tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] HTTP exception thrown: Instance 5b73f1a1-e07f-4ebe-af69-e188924a9073 could not be found. Jul 28 04:10:17.224367 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b913af90-b1a8-4c0e-a5e9-497668abdcfd tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Request method failure captured: Jul 28 04:10:17.224367 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: DELETE /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 HTTP/1.1 Jul 28 04:10:17.224367 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:10:17.224367 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:10:17.224367 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:10:17.224367 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:10:17.224367 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:10:17.224367 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:10:17.224367 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:10:17.224367 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:10:17.224367 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gpzwOklwNPcAxBHZOI1ssvbTDgevywfPDg1yEt0tUb4vs9CGIW1HscS9ZkGWtQaBkjtwjYHRZPMEfCBroYl-luuwuhVsCRgo82EETIhmv-q8utzHf0HSy0tMariOS19fBjcoglWOQOMyj-zi_XUYhE5beKJEpg4A_NllVniOatsHmc Jul 28 04:10:17.224367 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:10:17.224367 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:10:17.224367 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:10:17.224367 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:10:17.224367 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:10:17.224367 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:10:17.224367 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 338679f381ed4e9e898a59289b0f8178 Jul 28 04:10:17.224367 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-TestVolumeBootPattern-143181242 Jul 28 04:10:17.224367 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:10:17.224367 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:10:17.225927 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_338679f381ed4e9e898a59289b0f8178", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/338679f381ed4e9e898a59289b0f8178"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/338679f381ed4e9e898a59289b0f8178"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/338679f381ed4e9e898a59289b0f8178"}]}] Jul 28 04:10:17.225927 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-TestVolumeBootPattern-143181242 Jul 28 04:10:17.225927 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 338679f381ed4e9e898a59289b0f8178 Jul 28 04:10:17.225927 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-TestVolumeBootPattern-143181242 Jul 28 04:10:17.225927 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-TestVolumeBootPattern-143181242-project Jul 28 04:10:17.225927 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:10:17.225927 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:10:17.225927 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: 352d60372ba249e38ea4aa2d62723f19 Jul 28 04:10:17.225927 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-TestVolumeBootPattern-143181242-project Jul 28 04:10:17.225927 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:10:17.225927 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Instance 5b73f1a1-e07f-4ebe-af69-e188924a9073 could not be found. Jul 28 04:10:17.225927 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': '5b73f1a1-e07f-4ebe-af69-e188924a9073'} Jul 28 04:10:17.227164 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:10:17.227164 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:10:17.227164 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:10:17.227164 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:10:17.227164 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:10:17.227164 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:10:17.227164 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:10:17.227164 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:10:17.227164 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:10:17.227164 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:10:17.227164 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b73f1a1-e07f-4ebe-af69-e188924a9073 could not be found. Jul 28 04:10:17.227164 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:10:17.227164 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:10:17.227164 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:10:17.227164 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:10:17.227164 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:10:17.227164 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:10:17.227164 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:10:17.227164 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:10:17.227164 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:10:17.228639 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:10:17.228639 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:10:17.228639 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:10:17.228639 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:10:17.228639 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:10:17.228639 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:10:17.228639 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:10:17.228639 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:10:17.228639 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:10:17.228639 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b73f1a1-e07f-4ebe-af69-e188924a9073 could not be found. Jul 28 04:10:17.228639 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:10:17.228639 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:10:17.228639 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:10:17.228639 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:10:17.228639 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:10:17.228639 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:10:17.228639 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:10:17.228639 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:10:17.228639 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b73f1a1-e07f-4ebe-af69-e188924a9073 could not be found. Jul 28 04:10:17.228639 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:10:17.230324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b913af90-b1a8-4c0e-a5e9-497668abdcfd tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Returning 404 to user: Instance 5b73f1a1-e07f-4ebe-af69-e188924a9073 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:10:17.230324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b913af90-b1a8-4c0e-a5e9-497668abdcfd tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "DELETE /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 404 len: 111 microversion: 2.1 time: 0.028892 Jul 28 04:10:17.230324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 546/1028] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:10:17 2022] DELETE /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:10:17.234450 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-9a05e59f-3af2-4433-84b2-60e4c800e7a6 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:17.235103 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-9a05e59f-3af2-4433-84b2-60e4c800e7a6 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] [instance: 5b73f1a1-e07f-4ebe-af69-e188924a9073] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:17.241906 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9a05e59f-3af2-4433-84b2-60e4c800e7a6 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:17.242360 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9a05e59f-3af2-4433-84b2-60e4c800e7a6 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:17.243156 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9a05e59f-3af2-4433-84b2-60e4c800e7a6 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:17.243599 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9a05e59f-3af2-4433-84b2-60e4c800e7a6 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:17.256889 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.wsgi [None req-9a05e59f-3af2-4433-84b2-60e4c800e7a6 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] HTTP exception thrown: Instance 5b73f1a1-e07f-4ebe-af69-e188924a9073 could not be found. Jul 28 04:10:17.258501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-9a05e59f-3af2-4433-84b2-60e4c800e7a6 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Request method failure captured: Jul 28 04:10:17.258501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: request: GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 HTTP/1.1 Jul 28 04:10:17.258501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept: application/json Jul 28 04:10:17.258501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept-Encoding: identity Jul 28 04:10:17.258501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Connection: close Jul 28 04:10:17.258501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Length: 0 Jul 28 04:10:17.258501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Type: application/json Jul 28 04:10:17.258501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Host: 10.222.0.46 Jul 28 04:10:17.258501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Openstack-System-Scope: None Jul 28 04:10:17.258501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: User-Agent: python-urllib3/1.26.10 Jul 28 04:10:17.258501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Auth-Token: gAAAAABi4gpzwOklwNPcAxBHZOI1ssvbTDgevywfPDg1yEt0tUb4vs9CGIW1HscS9ZkGWtQaBkjtwjYHRZPMEfCBroYl-luuwuhVsCRgo82EETIhmv-q8utzHf0HSy0tMariOS19fBjcoglWOQOMyj-zi_XUYhE5beKJEpg4A_NllVniOatsHmc Jul 28 04:10:17.258501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Id: None Jul 28 04:10:17.258501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Name: None Jul 28 04:10:17.258501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Identity-Status: Confirmed Jul 28 04:10:17.258501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Is-Admin-Project: True Jul 28 04:10:17.258501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Id: default Jul 28 04:10:17.258501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Name: Default Jul 28 04:10:17.258501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Id: 338679f381ed4e9e898a59289b0f8178 Jul 28 04:10:17.258501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Name: tempest-TestVolumeBootPattern-143181242 Jul 28 04:10:17.258501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Role: reader,member Jul 28 04:10:17.258501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Roles: reader,member Jul 28 04:10:17.260186 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_338679f381ed4e9e898a59289b0f8178", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/338679f381ed4e9e898a59289b0f8178"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/338679f381ed4e9e898a59289b0f8178"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/338679f381ed4e9e898a59289b0f8178"}]}] Jul 28 04:10:17.260186 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant: tempest-TestVolumeBootPattern-143181242 Jul 28 04:10:17.260186 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Id: 338679f381ed4e9e898a59289b0f8178 Jul 28 04:10:17.260186 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Name: tempest-TestVolumeBootPattern-143181242 Jul 28 04:10:17.260186 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User: tempest-TestVolumeBootPattern-143181242-project Jul 28 04:10:17.260186 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Id: default Jul 28 04:10:17.260186 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Name: Default Jul 28 04:10:17.260186 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Id: 352d60372ba249e38ea4aa2d62723f19 Jul 28 04:10:17.260186 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Name: tempest-TestVolumeBootPattern-143181242-project Jul 28 04:10:17.260186 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: method: > Jul 28 04:10:17.260186 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: exception: Instance 5b73f1a1-e07f-4ebe-af69-e188924a9073 could not be found. Jul 28 04:10:17.260186 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: action_args: {'id': '5b73f1a1-e07f-4ebe-af69-e188924a9073'} Jul 28 04:10:17.261150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:10:17.261150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:10:17.261150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:10:17.261150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:10:17.261150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:10:17.261150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:10:17.261150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:10:17.261150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:10:17.261150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:10:17.261150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:10:17.261150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b73f1a1-e07f-4ebe-af69-e188924a9073 could not be found. Jul 28 04:10:17.261150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:10:17.261150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:10:17.261150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:10:17.261150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:10:17.261150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:10:17.261150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:10:17.261150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:10:17.261150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:10:17.261150 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:10:17.263002 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:10:17.263002 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:10:17.263002 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:10:17.263002 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:10:17.263002 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:10:17.263002 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:10:17.263002 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:10:17.263002 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b73f1a1-e07f-4ebe-af69-e188924a9073 could not be found. Jul 28 04:10:17.263002 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:10:17.263002 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:10:17.263002 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:10:17.263002 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:10:17.263002 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:10:17.263002 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:10:17.263002 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:10:17.263002 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:10:17.263002 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b73f1a1-e07f-4ebe-af69-e188924a9073 could not be found. Jul 28 04:10:17.263002 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:10:17.264625 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-9a05e59f-3af2-4433-84b2-60e4c800e7a6 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Returning 404 to user: Instance 5b73f1a1-e07f-4ebe-af69-e188924a9073 could not be found. {{(pid=118186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:10:17.264625 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-9a05e59f-3af2-4433-84b2-60e4c800e7a6 tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073" status: 404 len: 111 microversion: 2.1 time: 0.029391 Jul 28 04:10:17.264625 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 483/1029] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:10:17 2022] GET /compute/v2.1/servers/5b73f1a1-e07f-4ebe-af69-e188924a9073 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:10:17.956533 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c391597d-a759-40a9-9b9b-6407a43e049e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:17.957146 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c391597d-a759-40a9-9b9b-6407a43e049e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:17.963640 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c391597d-a759-40a9-9b9b-6407a43e049e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:17.964092 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c391597d-a759-40a9-9b9b-6407a43e049e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:17.964846 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c391597d-a759-40a9-9b9b-6407a43e049e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:17.965277 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c391597d-a759-40a9-9b9b-6407a43e049e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:18.098844 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c391597d-a759-40a9-9b9b-6407a43e049e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:18.106987 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c391597d-a759-40a9-9b9b-6407a43e049e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:18.108484 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c391597d-a759-40a9-9b9b-6407a43e049e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:18.109672 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c391597d-a759-40a9-9b9b-6407a43e049e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1724 microversion: 2.20 time: 0.157105 Jul 28 04:10:18.110247 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 547/1030] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:17 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:18.554314 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-7ff177a8-ef56-47d0-8ea2-c695588716ff tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] Calling method '.version_select at 0x7fa6ee11a9d0>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:18.576725 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-7ff177a8-ef56-47d0-8ea2-c695588716ff tempest-TestVolumeBootPattern-143181242 tempest-TestVolumeBootPattern-143181242-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1551827242" status: 202 len: 0 microversion: 2.1 time: 0.026336 Jul 28 04:10:18.577736 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 484/1031] 10.222.0.46 () {58 vars in 1263 bytes} [Thu Jul 28 04:10:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1551827242 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:10:19.132900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-350124cc-54bb-484f-95e4-807a850bc711 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:19.133521 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-350124cc-54bb-484f-95e4-807a850bc711 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:19.145788 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-350124cc-54bb-484f-95e4-807a850bc711 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:19.146242 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-350124cc-54bb-484f-95e4-807a850bc711 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:19.147046 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-350124cc-54bb-484f-95e4-807a850bc711 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:19.147485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-350124cc-54bb-484f-95e4-807a850bc711 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:19.372283 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-350124cc-54bb-484f-95e4-807a850bc711 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:19.380999 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-350124cc-54bb-484f-95e4-807a850bc711 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:19.382691 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-350124cc-54bb-484f-95e4-807a850bc711 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:19.383994 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-350124cc-54bb-484f-95e4-807a850bc711 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1724 microversion: 2.20 time: 0.254993 Jul 28 04:10:19.384555 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 548/1032] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:19 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:20.408627 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-e8f693d7-73fb-4f1a-b221-0d8404dd94d3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:20.410020 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-e8f693d7-73fb-4f1a-b221-0d8404dd94d3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:20.417419 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e8f693d7-73fb-4f1a-b221-0d8404dd94d3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:20.418137 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e8f693d7-73fb-4f1a-b221-0d8404dd94d3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:20.419232 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e8f693d7-73fb-4f1a-b221-0d8404dd94d3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:20.420548 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-e8f693d7-73fb-4f1a-b221-0d8404dd94d3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:20.562988 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-e8f693d7-73fb-4f1a-b221-0d8404dd94d3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:20.571673 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-e8f693d7-73fb-4f1a-b221-0d8404dd94d3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:20.573181 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-e8f693d7-73fb-4f1a-b221-0d8404dd94d3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:20.574363 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-e8f693d7-73fb-4f1a-b221-0d8404dd94d3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1724 microversion: 2.20 time: 0.170882 Jul 28 04:10:20.575142 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 485/1033] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:20 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:21.603509 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-c91757b2-bb35-4b4e-a98b-eb86db68b2e8 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:21.605178 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-c91757b2-bb35-4b4e-a98b-eb86db68b2e8 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:21.613574 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c91757b2-bb35-4b4e-a98b-eb86db68b2e8 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:21.614532 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c91757b2-bb35-4b4e-a98b-eb86db68b2e8 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:21.615381 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c91757b2-bb35-4b4e-a98b-eb86db68b2e8 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:21.615821 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-c91757b2-bb35-4b4e-a98b-eb86db68b2e8 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:21.776838 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c91757b2-bb35-4b4e-a98b-eb86db68b2e8 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:21.785654 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c91757b2-bb35-4b4e-a98b-eb86db68b2e8 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:21.787548 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-c91757b2-bb35-4b4e-a98b-eb86db68b2e8 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:21.789225 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-c91757b2-bb35-4b4e-a98b-eb86db68b2e8 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1745 microversion: 2.20 time: 0.195220 Jul 28 04:10:21.795923 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 549/1034] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:21 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1745 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:22.814647 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-54f811fd-9315-4494-adf3-7993948452f5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:22.815996 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-54f811fd-9315-4494-adf3-7993948452f5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:22.822675 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-54f811fd-9315-4494-adf3-7993948452f5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:22.823487 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-54f811fd-9315-4494-adf3-7993948452f5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:22.824287 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-54f811fd-9315-4494-adf3-7993948452f5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:22.824730 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-54f811fd-9315-4494-adf3-7993948452f5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:22.962631 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-54f811fd-9315-4494-adf3-7993948452f5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:22.970831 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-54f811fd-9315-4494-adf3-7993948452f5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:22.972365 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-54f811fd-9315-4494-adf3-7993948452f5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:22.973549 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-54f811fd-9315-4494-adf3-7993948452f5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1745 microversion: 2.20 time: 0.163925 Jul 28 04:10:22.974109 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 486/1035] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:22 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1745 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:23.998057 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-2f30afa7-820c-400a-b27e-38e48b00d6ce tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:23.998682 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-2f30afa7-820c-400a-b27e-38e48b00d6ce tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:24.009649 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2f30afa7-820c-400a-b27e-38e48b00d6ce tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:24.010063 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2f30afa7-820c-400a-b27e-38e48b00d6ce tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:24.010808 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2f30afa7-820c-400a-b27e-38e48b00d6ce tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:24.011269 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-2f30afa7-820c-400a-b27e-38e48b00d6ce tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:24.286774 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-2f30afa7-820c-400a-b27e-38e48b00d6ce tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:24.305483 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-2f30afa7-820c-400a-b27e-38e48b00d6ce tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:24.308324 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-2f30afa7-820c-400a-b27e-38e48b00d6ce tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:24.310226 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-2f30afa7-820c-400a-b27e-38e48b00d6ce tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1740 microversion: 2.20 time: 0.316410 Jul 28 04:10:24.311262 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 550/1036] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:23 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1740 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:25.336113 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-24ebcaa7-5467-44c9-b339-996ca00f5549 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:25.336878 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-24ebcaa7-5467-44c9-b339-996ca00f5549 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:25.348696 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-24ebcaa7-5467-44c9-b339-996ca00f5549 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:25.349409 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-24ebcaa7-5467-44c9-b339-996ca00f5549 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:25.350422 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-24ebcaa7-5467-44c9-b339-996ca00f5549 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:25.352318 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-24ebcaa7-5467-44c9-b339-996ca00f5549 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:25.613032 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-24ebcaa7-5467-44c9-b339-996ca00f5549 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:25.623143 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-24ebcaa7-5467-44c9-b339-996ca00f5549 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:25.625080 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-24ebcaa7-5467-44c9-b339-996ca00f5549 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:25.627058 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-24ebcaa7-5467-44c9-b339-996ca00f5549 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1740 microversion: 2.20 time: 0.295045 Jul 28 04:10:25.643333 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 487/1037] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:25 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1740 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:25.728862 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-9007ea3e-e7ba-4bba-95ce-234b33380c4f req-3002d360-d022-4ccc-b8e3-b1a640315eb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b67751f-bbbc-48cc-9286-3312b89f746d", "name": "network-vif-plugged", "status": "completed", "tag": "f5acb90a-f577-4063-9575-472c6b002484"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:25.750718 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:25.757798 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-9007ea3e-e7ba-4bba-95ce-234b33380c4f req-3002d360-d022-4ccc-b8e3-b1a640315eb9 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:25.759006 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-9007ea3e-e7ba-4bba-95ce-234b33380c4f req-3002d360-d022-4ccc-b8e3-b1a640315eb9 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:25.786646 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-9007ea3e-e7ba-4bba-95ce-234b33380c4f req-3002d360-d022-4ccc-b8e3-b1a640315eb9 service nova] Creating event network-vif-plugged:f5acb90a-f577-4063-9575-472c6b002484 for instance 7b67751f-bbbc-48cc-9286-3312b89f746d on hv-cinder-79987 Jul 28 04:10:25.808496 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-9007ea3e-e7ba-4bba-95ce-234b33380c4f req-3002d360-d022-4ccc-b8e3-b1a640315eb9 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.075059 Jul 28 04:10:25.811050 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 551/1038] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:10:26.652696 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-5946746f-5d5f-4fc0-b45d-4414054429cd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:26.653962 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-5946746f-5d5f-4fc0-b45d-4414054429cd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:26.656559 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:26.663191 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5946746f-5d5f-4fc0-b45d-4414054429cd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:26.663907 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5946746f-5d5f-4fc0-b45d-4414054429cd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:26.664829 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5946746f-5d5f-4fc0-b45d-4414054429cd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:26.665315 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5946746f-5d5f-4fc0-b45d-4414054429cd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:26.840578 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-5946746f-5d5f-4fc0-b45d-4414054429cd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:26.849686 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-5946746f-5d5f-4fc0-b45d-4414054429cd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:26.851180 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-5946746f-5d5f-4fc0-b45d-4414054429cd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:26.852565 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-5946746f-5d5f-4fc0-b45d-4414054429cd tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1740 microversion: 2.20 time: 0.204572 Jul 28 04:10:26.853132 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 488/1039] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:26 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1740 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:27.877583 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-018a929f-f2c6-4b65-9b81-26781bf4c5c5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:27.879091 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-018a929f-f2c6-4b65-9b81-26781bf4c5c5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:27.886714 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-018a929f-f2c6-4b65-9b81-26781bf4c5c5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:27.887476 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-018a929f-f2c6-4b65-9b81-26781bf4c5c5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:27.888494 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-018a929f-f2c6-4b65-9b81-26781bf4c5c5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:27.888939 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-018a929f-f2c6-4b65-9b81-26781bf4c5c5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:28.041240 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-018a929f-f2c6-4b65-9b81-26781bf4c5c5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:28.056814 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-018a929f-f2c6-4b65-9b81-26781bf4c5c5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:28.058653 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-018a929f-f2c6-4b65-9b81-26781bf4c5c5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:28.059881 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-018a929f-f2c6-4b65-9b81-26781bf4c5c5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1740 microversion: 2.20 time: 0.186791 Jul 28 04:10:28.060443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 552/1040] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:27 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1740 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:29.083972 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-aab8ab76-9819-4efa-8a40-076bf6adb6e1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:29.085809 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-aab8ab76-9819-4efa-8a40-076bf6adb6e1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:29.095646 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-aab8ab76-9819-4efa-8a40-076bf6adb6e1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:29.097048 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-aab8ab76-9819-4efa-8a40-076bf6adb6e1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:29.098930 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-aab8ab76-9819-4efa-8a40-076bf6adb6e1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:29.099899 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-aab8ab76-9819-4efa-8a40-076bf6adb6e1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:29.262688 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-aab8ab76-9819-4efa-8a40-076bf6adb6e1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:29.273714 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-aab8ab76-9819-4efa-8a40-076bf6adb6e1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:29.275301 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-aab8ab76-9819-4efa-8a40-076bf6adb6e1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:29.276511 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-aab8ab76-9819-4efa-8a40-076bf6adb6e1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1740 microversion: 2.20 time: 0.196489 Jul 28 04:10:29.277602 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 489/1041] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:29 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:10:30.307076 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-fe08c620-8bd6-45a1-95ed-2c688f0fbb56 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:30.307826 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-fe08c620-8bd6-45a1-95ed-2c688f0fbb56 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:30.315089 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fe08c620-8bd6-45a1-95ed-2c688f0fbb56 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:30.315558 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fe08c620-8bd6-45a1-95ed-2c688f0fbb56 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:30.316502 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fe08c620-8bd6-45a1-95ed-2c688f0fbb56 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:30.317117 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-fe08c620-8bd6-45a1-95ed-2c688f0fbb56 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:30.462286 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-fe08c620-8bd6-45a1-95ed-2c688f0fbb56 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:30.471878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-fe08c620-8bd6-45a1-95ed-2c688f0fbb56 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:30.473411 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-fe08c620-8bd6-45a1-95ed-2c688f0fbb56 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:30.474609 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-fe08c620-8bd6-45a1-95ed-2c688f0fbb56 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1740 microversion: 2.20 time: 0.171577 Jul 28 04:10:30.475572 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 553/1042] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:30 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1740 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:31.498589 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-4fb6d921-d259-45ad-9181-612a8d63e294 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:31.499292 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-4fb6d921-d259-45ad-9181-612a8d63e294 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:31.506196 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4fb6d921-d259-45ad-9181-612a8d63e294 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:31.506651 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4fb6d921-d259-45ad-9181-612a8d63e294 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:31.509308 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4fb6d921-d259-45ad-9181-612a8d63e294 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:31.509308 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4fb6d921-d259-45ad-9181-612a8d63e294 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:31.655348 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-4fb6d921-d259-45ad-9181-612a8d63e294 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:31.666450 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-4fb6d921-d259-45ad-9181-612a8d63e294 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:31.668041 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-4fb6d921-d259-45ad-9181-612a8d63e294 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:31.669269 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-4fb6d921-d259-45ad-9181-612a8d63e294 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1740 microversion: 2.20 time: 0.174606 Jul 28 04:10:31.669838 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 490/1043] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:31 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:32.693674 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a8201a59-bb61-4acf-89b9-6cac1c2e8a7f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:32.694465 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a8201a59-bb61-4acf-89b9-6cac1c2e8a7f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:32.700868 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a8201a59-bb61-4acf-89b9-6cac1c2e8a7f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:32.701398 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a8201a59-bb61-4acf-89b9-6cac1c2e8a7f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:32.702238 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a8201a59-bb61-4acf-89b9-6cac1c2e8a7f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:32.702751 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a8201a59-bb61-4acf-89b9-6cac1c2e8a7f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:32.851992 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a8201a59-bb61-4acf-89b9-6cac1c2e8a7f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:32.861548 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a8201a59-bb61-4acf-89b9-6cac1c2e8a7f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:32.863097 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a8201a59-bb61-4acf-89b9-6cac1c2e8a7f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:32.864412 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a8201a59-bb61-4acf-89b9-6cac1c2e8a7f tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1740 microversion: 2.20 time: 0.174633 Jul 28 04:10:32.864969 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 554/1044] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:32 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:33.892074 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-5b7cff04-11bc-436d-a515-8ed7fc847505 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:33.893125 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-5b7cff04-11bc-436d-a515-8ed7fc847505 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:33.899879 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5b7cff04-11bc-436d-a515-8ed7fc847505 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:33.900330 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5b7cff04-11bc-436d-a515-8ed7fc847505 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:33.901099 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5b7cff04-11bc-436d-a515-8ed7fc847505 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:33.901536 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5b7cff04-11bc-436d-a515-8ed7fc847505 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:34.110852 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-5b7cff04-11bc-436d-a515-8ed7fc847505 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:34.118987 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-5b7cff04-11bc-436d-a515-8ed7fc847505 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:34.120490 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-5b7cff04-11bc-436d-a515-8ed7fc847505 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:34.121647 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-5b7cff04-11bc-436d-a515-8ed7fc847505 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1722 microversion: 2.20 time: 0.236665 Jul 28 04:10:34.122197 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 491/1045] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:33 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:35.145483 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-dd9b140f-6dd2-4619-8653-3ad3be047117 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:35.146109 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-dd9b140f-6dd2-4619-8653-3ad3be047117 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:35.152670 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dd9b140f-6dd2-4619-8653-3ad3be047117 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:35.153131 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dd9b140f-6dd2-4619-8653-3ad3be047117 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:35.153901 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dd9b140f-6dd2-4619-8653-3ad3be047117 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:35.154347 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dd9b140f-6dd2-4619-8653-3ad3be047117 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:35.280914 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-dd9b140f-6dd2-4619-8653-3ad3be047117 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:35.289199 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-dd9b140f-6dd2-4619-8653-3ad3be047117 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:35.290724 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-dd9b140f-6dd2-4619-8653-3ad3be047117 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:35.291920 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-dd9b140f-6dd2-4619-8653-3ad3be047117 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1722 microversion: 2.20 time: 0.151083 Jul 28 04:10:35.292477 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 555/1046] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:35 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:36.314213 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-46e6890f-573f-4ecf-bcc0-4ce84ede8a28 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:36.314878 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-46e6890f-573f-4ecf-bcc0-4ce84ede8a28 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:36.321601 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-46e6890f-573f-4ecf-bcc0-4ce84ede8a28 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:36.322053 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-46e6890f-573f-4ecf-bcc0-4ce84ede8a28 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:36.322896 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-46e6890f-573f-4ecf-bcc0-4ce84ede8a28 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:36.323342 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-46e6890f-573f-4ecf-bcc0-4ce84ede8a28 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:36.452965 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-46e6890f-573f-4ecf-bcc0-4ce84ede8a28 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:36.461116 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-46e6890f-573f-4ecf-bcc0-4ce84ede8a28 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:36.462758 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-46e6890f-573f-4ecf-bcc0-4ce84ede8a28 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:36.463964 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-46e6890f-573f-4ecf-bcc0-4ce84ede8a28 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1665 microversion: 2.20 time: 0.153813 Jul 28 04:10:36.464531 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 492/1047] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:36 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1665 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:36.486620 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-53827f2e-034f-4dd2-95ff-9a30a1479e68 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ad6be5d2-eaa4-4751-b004-c9d26e4e51b1"}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:36.488972 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-53827f2e-034f-4dd2-95ff-9a30a1479e68 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:36.495514 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-53827f2e-034f-4dd2-95ff-9a30a1479e68 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:36.495975 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-53827f2e-034f-4dd2-95ff-9a30a1479e68 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:36.496742 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-53827f2e-034f-4dd2-95ff-9a30a1479e68 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:36.497187 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-53827f2e-034f-4dd2-95ff-9a30a1479e68 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:36.767541 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-53827f2e-034f-4dd2-95ff-9a30a1479e68 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "POST /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.285502 Jul 28 04:10:36.768151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 556/1048] 10.222.0.46 () {62 vars in 1364 bytes} [Thu Jul 28 04:10:36 2022] POST /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d/os-volume_attachments => generated 188 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 28 04:10:36.893906 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-46b51f5c-f5eb-4d6a-817a-30a7d9ba4e87 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:36.894572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-46b51f5c-f5eb-4d6a-817a-30a7d9ba4e87 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:36.901357 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-46b51f5c-f5eb-4d6a-817a-30a7d9ba4e87 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:36.901879 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-46b51f5c-f5eb-4d6a-817a-30a7d9ba4e87 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:36.902649 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-46b51f5c-f5eb-4d6a-817a-30a7d9ba4e87 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:36.903107 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-46b51f5c-f5eb-4d6a-817a-30a7d9ba4e87 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:37.326390 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-46b51f5c-f5eb-4d6a-817a-30a7d9ba4e87 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d/os-volume_attachments/ad6be5d2-eaa4-4751-b004-c9d26e4e51b1" status: 202 len: 0 microversion: 2.20 time: 0.437116 Jul 28 04:10:37.327457 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 493/1049] 10.222.0.46 () {60 vars in 1457 bytes} [Thu Jul 28 04:10:36 2022] DELETE /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d/os-volume_attachments/ad6be5d2-eaa4-4751-b004-c9d26e4e51b1 => generated 0 bytes in 439 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:10:37.387248 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b1e9186b-be15-4bdc-bfc8-f14c536a0cf6 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:37.387847 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b1e9186b-be15-4bdc-bfc8-f14c536a0cf6 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:37.394190 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b1e9186b-be15-4bdc-bfc8-f14c536a0cf6 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:37.394642 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b1e9186b-be15-4bdc-bfc8-f14c536a0cf6 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:37.395439 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b1e9186b-be15-4bdc-bfc8-f14c536a0cf6 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:37.395879 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b1e9186b-be15-4bdc-bfc8-f14c536a0cf6 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:37.530311 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b1e9186b-be15-4bdc-bfc8-f14c536a0cf6 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118187) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 04:10:37.601151 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b1e9186b-be15-4bdc-bfc8-f14c536a0cf6 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "POST /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d/action" status: 202 len: 0 microversion: 2.20 time: 0.217736 Jul 28 04:10:37.604934 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 557/1050] 10.222.0.46 () {62 vars in 1319 bytes} [Thu Jul 28 04:10:37 2022] POST /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d/action => generated 0 bytes in 219 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:10:37.610732 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-c70d9d73-8f25-414c-ba1c-94c6be342775 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:37.612069 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-c70d9d73-8f25-414c-ba1c-94c6be342775 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:37.618716 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c70d9d73-8f25-414c-ba1c-94c6be342775 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:37.619231 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c70d9d73-8f25-414c-ba1c-94c6be342775 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:37.620192 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c70d9d73-8f25-414c-ba1c-94c6be342775 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:37.620804 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-c70d9d73-8f25-414c-ba1c-94c6be342775 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:37.774041 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-c70d9d73-8f25-414c-ba1c-94c6be342775 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:37.783548 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-c70d9d73-8f25-414c-ba1c-94c6be342775 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:37.785092 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-c70d9d73-8f25-414c-ba1c-94c6be342775 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:37.786284 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-c70d9d73-8f25-414c-ba1c-94c6be342775 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1673 microversion: 2.20 time: 0.180110 Jul 28 04:10:37.787180 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 494/1051] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:37 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1673 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:37.796596 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-37bfaac0-d4cd-49ff-a427-a0413f5c81e4 req-4233dc15-59a8-48e1-a885-baf1c01e92e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b67751f-bbbc-48cc-9286-3312b89f746d", "name": "network-vif-unplugged", "status": "completed", "tag": "f5acb90a-f577-4063-9575-472c6b002484"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:37.812804 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-37bfaac0-d4cd-49ff-a427-a0413f5c81e4 req-4233dc15-59a8-48e1-a885-baf1c01e92e2 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:37.813923 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-37bfaac0-d4cd-49ff-a427-a0413f5c81e4 req-4233dc15-59a8-48e1-a885-baf1c01e92e2 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:37.825381 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.compute.server_external_events [req-37bfaac0-d4cd-49ff-a427-a0413f5c81e4 req-4233dc15-59a8-48e1-a885-baf1c01e92e2 service nova] Unable to find a host for instance 7b67751f-bbbc-48cc-9286-3312b89f746d. Dropping event network-vif-unplugged {{(pid=118187) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 28 04:10:37.826262 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-37bfaac0-d4cd-49ff-a427-a0413f5c81e4 req-4233dc15-59a8-48e1-a885-baf1c01e92e2 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.176673 Jul 28 04:10:37.826855 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 558/1052] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 178 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 28 04:10:38.810995 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-3f7cc108-afe1-4661-8bc6-308a502819b1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:38.811618 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-3f7cc108-afe1-4661-8bc6-308a502819b1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:38.818142 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3f7cc108-afe1-4661-8bc6-308a502819b1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:38.818604 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3f7cc108-afe1-4661-8bc6-308a502819b1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:38.819421 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3f7cc108-afe1-4661-8bc6-308a502819b1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:38.819860 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-3f7cc108-afe1-4661-8bc6-308a502819b1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:39.025940 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-3f7cc108-afe1-4661-8bc6-308a502819b1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:39.034670 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-3f7cc108-afe1-4661-8bc6-308a502819b1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:39.036235 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-3f7cc108-afe1-4661-8bc6-308a502819b1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:39.037419 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-3f7cc108-afe1-4661-8bc6-308a502819b1 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1731 microversion: 2.20 time: 0.230406 Jul 28 04:10:39.037994 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 495/1053] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:38 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1731 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:40.062191 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-631df9e7-220e-4e7c-9e4b-2e3a0d687717 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:40.064416 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-631df9e7-220e-4e7c-9e4b-2e3a0d687717 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:40.071649 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-631df9e7-220e-4e7c-9e4b-2e3a0d687717 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:40.072464 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-631df9e7-220e-4e7c-9e4b-2e3a0d687717 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:40.073469 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-631df9e7-220e-4e7c-9e4b-2e3a0d687717 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:40.074132 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-631df9e7-220e-4e7c-9e4b-2e3a0d687717 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:40.235288 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-631df9e7-220e-4e7c-9e4b-2e3a0d687717 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:40.239115 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:40.245789 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-631df9e7-220e-4e7c-9e4b-2e3a0d687717 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:40.247614 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-631df9e7-220e-4e7c-9e4b-2e3a0d687717 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:40.249011 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-631df9e7-220e-4e7c-9e4b-2e3a0d687717 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1731 microversion: 2.20 time: 0.190740 Jul 28 04:10:40.249738 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 559/1054] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:40 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1731 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 28 04:10:41.273585 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-aca0470d-44e0-437e-9d13-1019a28836c8 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:41.274207 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-aca0470d-44e0-437e-9d13-1019a28836c8 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:41.281304 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-aca0470d-44e0-437e-9d13-1019a28836c8 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:41.281823 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-aca0470d-44e0-437e-9d13-1019a28836c8 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:41.282754 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-aca0470d-44e0-437e-9d13-1019a28836c8 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:41.283213 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-aca0470d-44e0-437e-9d13-1019a28836c8 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:41.436281 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-aca0470d-44e0-437e-9d13-1019a28836c8 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:41.445603 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-aca0470d-44e0-437e-9d13-1019a28836c8 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:41.447256 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-aca0470d-44e0-437e-9d13-1019a28836c8 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:41.448509 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-aca0470d-44e0-437e-9d13-1019a28836c8 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1731 microversion: 2.20 time: 0.178862 Jul 28 04:10:41.449082 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 496/1055] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:41 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1731 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:42.473228 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-1b5f4954-e6cb-4c28-8e5b-3ef032172068 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:42.473849 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-1b5f4954-e6cb-4c28-8e5b-3ef032172068 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:42.481332 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1b5f4954-e6cb-4c28-8e5b-3ef032172068 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:42.481787 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1b5f4954-e6cb-4c28-8e5b-3ef032172068 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:42.482738 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1b5f4954-e6cb-4c28-8e5b-3ef032172068 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:42.483207 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-1b5f4954-e6cb-4c28-8e5b-3ef032172068 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:42.632611 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1b5f4954-e6cb-4c28-8e5b-3ef032172068 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:42.640868 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1b5f4954-e6cb-4c28-8e5b-3ef032172068 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:42.642489 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-1b5f4954-e6cb-4c28-8e5b-3ef032172068 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:42.643810 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-1b5f4954-e6cb-4c28-8e5b-3ef032172068 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1731 microversion: 2.20 time: 0.176022 Jul 28 04:10:42.644470 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 560/1056] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:42 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1731 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:43.672287 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-dca0ec5a-aa20-4b2c-a225-4830d7712776 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:43.673669 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-dca0ec5a-aa20-4b2c-a225-4830d7712776 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:43.680410 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dca0ec5a-aa20-4b2c-a225-4830d7712776 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:43.680945 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dca0ec5a-aa20-4b2c-a225-4830d7712776 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:43.681819 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dca0ec5a-aa20-4b2c-a225-4830d7712776 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:43.682331 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-dca0ec5a-aa20-4b2c-a225-4830d7712776 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:43.824603 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-dca0ec5a-aa20-4b2c-a225-4830d7712776 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:43.826808 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:10:43.834930 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-dca0ec5a-aa20-4b2c-a225-4830d7712776 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:43.836464 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-dca0ec5a-aa20-4b2c-a225-4830d7712776 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:43.837713 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-dca0ec5a-aa20-4b2c-a225-4830d7712776 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1731 microversion: 2.20 time: 0.169411 Jul 28 04:10:43.838280 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 497/1057] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:43 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:44.862114 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-047406f7-3fae-4843-bc13-76977724a3c9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:44.863090 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-047406f7-3fae-4843-bc13-76977724a3c9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:44.871810 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-047406f7-3fae-4843-bc13-76977724a3c9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:44.872540 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-047406f7-3fae-4843-bc13-76977724a3c9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:44.873575 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-047406f7-3fae-4843-bc13-76977724a3c9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:44.874182 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-047406f7-3fae-4843-bc13-76977724a3c9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:45.009562 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-047406f7-3fae-4843-bc13-76977724a3c9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:45.018385 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-047406f7-3fae-4843-bc13-76977724a3c9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:45.019973 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-047406f7-3fae-4843-bc13-76977724a3c9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:45.021179 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-047406f7-3fae-4843-bc13-76977724a3c9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1731 microversion: 2.20 time: 0.164606 Jul 28 04:10:45.021985 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 561/1058] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:44 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1731 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:46.044709 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a4c31221-6a78-439d-9f4b-00a3cb7c2e6d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:46.045455 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-a4c31221-6a78-439d-9f4b-00a3cb7c2e6d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:46.052620 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a4c31221-6a78-439d-9f4b-00a3cb7c2e6d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:46.053064 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a4c31221-6a78-439d-9f4b-00a3cb7c2e6d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:46.053825 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a4c31221-6a78-439d-9f4b-00a3cb7c2e6d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:46.054251 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a4c31221-6a78-439d-9f4b-00a3cb7c2e6d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:46.198099 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-a4c31221-6a78-439d-9f4b-00a3cb7c2e6d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:46.207996 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-a4c31221-6a78-439d-9f4b-00a3cb7c2e6d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:46.210063 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-a4c31221-6a78-439d-9f4b-00a3cb7c2e6d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:46.211382 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-a4c31221-6a78-439d-9f4b-00a3cb7c2e6d tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1731 microversion: 2.20 time: 0.171375 Jul 28 04:10:46.212335 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 498/1059] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:46 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:47.235732 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e7096f93-d8ea-4cc9-8add-e01e42bbe14c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:47.236595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e7096f93-d8ea-4cc9-8add-e01e42bbe14c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:47.243412 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e7096f93-d8ea-4cc9-8add-e01e42bbe14c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:47.243961 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e7096f93-d8ea-4cc9-8add-e01e42bbe14c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:47.244816 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e7096f93-d8ea-4cc9-8add-e01e42bbe14c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:47.245323 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e7096f93-d8ea-4cc9-8add-e01e42bbe14c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:47.385491 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e7096f93-d8ea-4cc9-8add-e01e42bbe14c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:47.394138 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e7096f93-d8ea-4cc9-8add-e01e42bbe14c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:47.395692 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-e7096f93-d8ea-4cc9-8add-e01e42bbe14c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:47.396863 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e7096f93-d8ea-4cc9-8add-e01e42bbe14c tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1731 microversion: 2.20 time: 0.165735 Jul 28 04:10:47.397428 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 562/1060] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:47 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:48.420142 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-163ca97a-ec6f-4d72-ae3e-feec24ca4ea5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:48.420681 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-163ca97a-ec6f-4d72-ae3e-feec24ca4ea5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:48.427551 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-163ca97a-ec6f-4d72-ae3e-feec24ca4ea5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:48.428007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-163ca97a-ec6f-4d72-ae3e-feec24ca4ea5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:48.428773 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-163ca97a-ec6f-4d72-ae3e-feec24ca4ea5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:48.429211 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-163ca97a-ec6f-4d72-ae3e-feec24ca4ea5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:48.565364 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-163ca97a-ec6f-4d72-ae3e-feec24ca4ea5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:48.573626 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-163ca97a-ec6f-4d72-ae3e-feec24ca4ea5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:48.575249 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-163ca97a-ec6f-4d72-ae3e-feec24ca4ea5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:48.576443 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-163ca97a-ec6f-4d72-ae3e-feec24ca4ea5 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1731 microversion: 2.20 time: 0.160237 Jul 28 04:10:48.577003 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 499/1061] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:48 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1731 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:49.600185 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-55fbde97-960e-4d22-b146-b0d687b90cfe tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:49.600812 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-55fbde97-960e-4d22-b146-b0d687b90cfe tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:49.607342 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55fbde97-960e-4d22-b146-b0d687b90cfe tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:49.607793 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55fbde97-960e-4d22-b146-b0d687b90cfe tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:49.608553 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55fbde97-960e-4d22-b146-b0d687b90cfe tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:49.608990 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55fbde97-960e-4d22-b146-b0d687b90cfe tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:49.740567 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-55fbde97-960e-4d22-b146-b0d687b90cfe tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:49.748615 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-55fbde97-960e-4d22-b146-b0d687b90cfe tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:49.750113 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-55fbde97-960e-4d22-b146-b0d687b90cfe tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:49.751469 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-55fbde97-960e-4d22-b146-b0d687b90cfe tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1731 microversion: 2.20 time: 0.155231 Jul 28 04:10:49.752027 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 563/1062] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:49 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:50.775388 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-276a2947-3084-43e6-b59c-cbdf00a46d08 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:50.776002 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-276a2947-3084-43e6-b59c-cbdf00a46d08 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:50.782870 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-276a2947-3084-43e6-b59c-cbdf00a46d08 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:50.783322 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-276a2947-3084-43e6-b59c-cbdf00a46d08 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:50.784078 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-276a2947-3084-43e6-b59c-cbdf00a46d08 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:50.784514 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-276a2947-3084-43e6-b59c-cbdf00a46d08 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:50.914021 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-276a2947-3084-43e6-b59c-cbdf00a46d08 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:50.921829 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-276a2947-3084-43e6-b59c-cbdf00a46d08 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:50.923546 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-276a2947-3084-43e6-b59c-cbdf00a46d08 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:50.924705 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-276a2947-3084-43e6-b59c-cbdf00a46d08 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1731 microversion: 2.20 time: 0.153303 Jul 28 04:10:50.925261 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 500/1063] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:50 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:51.730939 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-ee049f41-cc77-479e-bf1c-27ed674dddd9 req-a11d9697-0997-4cfc-8de8-5beecf3a1e61 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b67751f-bbbc-48cc-9286-3312b89f746d", "name": "network-vif-plugged", "status": "completed", "tag": "f5acb90a-f577-4063-9575-472c6b002484"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:10:51.741361 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-ee049f41-cc77-479e-bf1c-27ed674dddd9 req-a11d9697-0997-4cfc-8de8-5beecf3a1e61 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:51.741814 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-ee049f41-cc77-479e-bf1c-27ed674dddd9 req-a11d9697-0997-4cfc-8de8-5beecf3a1e61 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:51.753773 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-ee049f41-cc77-479e-bf1c-27ed674dddd9 req-a11d9697-0997-4cfc-8de8-5beecf3a1e61 service nova] Creating event network-vif-plugged:f5acb90a-f577-4063-9575-472c6b002484 for instance 7b67751f-bbbc-48cc-9286-3312b89f746d on hv-cinder-79987 Jul 28 04:10:51.758724 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-ee049f41-cc77-479e-bf1c-27ed674dddd9 req-a11d9697-0997-4cfc-8de8-5beecf3a1e61 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031547 Jul 28 04:10:51.759506 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 564/1064] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:10:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 28 04:10:51.947471 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-529b2933-a302-4c03-90de-8276151aebb3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:51.948116 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-529b2933-a302-4c03-90de-8276151aebb3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:51.955182 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-529b2933-a302-4c03-90de-8276151aebb3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:51.955637 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-529b2933-a302-4c03-90de-8276151aebb3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:51.956411 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-529b2933-a302-4c03-90de-8276151aebb3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:51.956839 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-529b2933-a302-4c03-90de-8276151aebb3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:52.084334 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-529b2933-a302-4c03-90de-8276151aebb3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:52.092167 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-529b2933-a302-4c03-90de-8276151aebb3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:52.093636 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-529b2933-a302-4c03-90de-8276151aebb3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:52.095037 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-529b2933-a302-4c03-90de-8276151aebb3 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1731 microversion: 2.20 time: 0.151828 Jul 28 04:10:52.095613 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 501/1065] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:51 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1731 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:53.118922 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a6166bba-d9ef-4a28-b5d7-b758ffafe592 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:53.119629 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a6166bba-d9ef-4a28-b5d7-b758ffafe592 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:53.125849 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a6166bba-d9ef-4a28-b5d7-b758ffafe592 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:53.126305 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a6166bba-d9ef-4a28-b5d7-b758ffafe592 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:53.127126 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a6166bba-d9ef-4a28-b5d7-b758ffafe592 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:53.127565 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a6166bba-d9ef-4a28-b5d7-b758ffafe592 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:53.257418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a6166bba-d9ef-4a28-b5d7-b758ffafe592 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:53.265717 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a6166bba-d9ef-4a28-b5d7-b758ffafe592 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:53.267396 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-a6166bba-d9ef-4a28-b5d7-b758ffafe592 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:53.268576 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a6166bba-d9ef-4a28-b5d7-b758ffafe592 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1731 microversion: 2.20 time: 0.154417 Jul 28 04:10:53.269139 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 565/1066] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:53 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1731 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:10:54.291936 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-cb23fcc7-41ef-4fc1-9e15-a2dfb3c4a87e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:10:54.292554 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-cb23fcc7-41ef-4fc1-9e15-a2dfb3c4a87e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:10:54.299108 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-cb23fcc7-41ef-4fc1-9e15-a2dfb3c4a87e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:54.299560 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-cb23fcc7-41ef-4fc1-9e15-a2dfb3c4a87e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:54.300320 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-cb23fcc7-41ef-4fc1-9e15-a2dfb3c4a87e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:10:54.300756 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-cb23fcc7-41ef-4fc1-9e15-a2dfb3c4a87e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:10:54.431598 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-cb23fcc7-41ef-4fc1-9e15-a2dfb3c4a87e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:54.439623 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-cb23fcc7-41ef-4fc1-9e15-a2dfb3c4a87e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:54.441128 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-cb23fcc7-41ef-4fc1-9e15-a2dfb3c4a87e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:10:54.442284 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-cb23fcc7-41ef-4fc1-9e15-a2dfb3c4a87e tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1718 microversion: 2.20 time: 0.154539 Jul 28 04:10:54.442863 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 502/1067] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:10:54 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1718 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:11:17.300003 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:11:17.300592 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Thu Jul 28 04:11:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:11:22.948189 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-354c11a6-16c9-4723-aed9-cbb3049db658 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:22.950323 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-354c11a6-16c9-4723-aed9-cbb3049db658 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:22.952382 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:22.953030 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=32 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:22.959362 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-354c11a6-16c9-4723-aed9-cbb3049db658 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:22.959815 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-354c11a6-16c9-4723-aed9-cbb3049db658 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:22.960581 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-354c11a6-16c9-4723-aed9-cbb3049db658 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:22.961021 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-354c11a6-16c9-4723-aed9-cbb3049db658 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:22.991587 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-354c11a6-16c9-4723-aed9-cbb3049db658 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047496 Jul 28 04:11:22.992127 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 566/1068] 10.222.0.46 () {60 vars in 1343 bytes} [Thu Jul 28 04:11:22 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:11:23.053640 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-d14c6c6f-6b3f-45a5-9ac2-2646ca1fd4e0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:23.054127 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-d14c6c6f-6b3f-45a5-9ac2-2646ca1fd4e0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:23.056357 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=29 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:23.057184 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=31 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:11:23.062603 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d14c6c6f-6b3f-45a5-9ac2-2646ca1fd4e0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:23.063089 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d14c6c6f-6b3f-45a5-9ac2-2646ca1fd4e0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:23.063864 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d14c6c6f-6b3f-45a5-9ac2-2646ca1fd4e0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:23.064311 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-d14c6c6f-6b3f-45a5-9ac2-2646ca1fd4e0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:23.089695 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-d14c6c6f-6b3f-45a5-9ac2-2646ca1fd4e0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Going to try to terminate instance {{(pid=118186) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:11:23.162084 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-d14c6c6f-6b3f-45a5-9ac2-2646ca1fd4e0 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 204 len: 0 microversion: 2.20 time: 0.112133 Jul 28 04:11:23.162842 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 503/1069] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 04:11:23 2022] DELETE /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 04:11:23.171356 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ded17e18-cd05-4a5d-a3bf-d53eced41f36 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:23.171973 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ded17e18-cd05-4a5d-a3bf-d53eced41f36 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:23.178130 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ded17e18-cd05-4a5d-a3bf-d53eced41f36 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:23.178586 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ded17e18-cd05-4a5d-a3bf-d53eced41f36 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:23.179390 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ded17e18-cd05-4a5d-a3bf-d53eced41f36 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:23.179856 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ded17e18-cd05-4a5d-a3bf-d53eced41f36 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:23.309839 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ded17e18-cd05-4a5d-a3bf-d53eced41f36 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:23.318336 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ded17e18-cd05-4a5d-a3bf-d53eced41f36 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:23.319871 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ded17e18-cd05-4a5d-a3bf-d53eced41f36 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:23.321035 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ded17e18-cd05-4a5d-a3bf-d53eced41f36 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1724 microversion: 2.20 time: 0.153582 Jul 28 04:11:23.321584 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 567/1070] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:11:23 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:11:24.344734 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-0f9dacb8-a99b-4841-ac5e-364a87d0d402 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:24.345437 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-0f9dacb8-a99b-4841-ac5e-364a87d0d402 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:24.351971 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0f9dacb8-a99b-4841-ac5e-364a87d0d402 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:24.352418 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0f9dacb8-a99b-4841-ac5e-364a87d0d402 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:24.353175 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0f9dacb8-a99b-4841-ac5e-364a87d0d402 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:24.353604 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-0f9dacb8-a99b-4841-ac5e-364a87d0d402 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:24.822930 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-0f9dacb8-a99b-4841-ac5e-364a87d0d402 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:24.830866 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-0f9dacb8-a99b-4841-ac5e-364a87d0d402 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:24.832376 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-0f9dacb8-a99b-4841-ac5e-364a87d0d402 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:24.834056 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-0f9dacb8-a99b-4841-ac5e-364a87d0d402 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1724 microversion: 2.20 time: 0.493654 Jul 28 04:11:24.834617 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 504/1071] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:11:24 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1724 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:11:25.540285 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-9d2d193f-d2af-4662-9848-7d821cd1997e req-607b5edd-5c0a-4869-8ba5-c6c421aa1b00 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7b67751f-bbbc-48cc-9286-3312b89f746d", "name": "network-vif-deleted", "tag": "f5acb90a-f577-4063-9575-472c6b002484"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:11:25.555424 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-9d2d193f-d2af-4662-9848-7d821cd1997e req-607b5edd-5c0a-4869-8ba5-c6c421aa1b00 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:25.555938 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-9d2d193f-d2af-4662-9848-7d821cd1997e req-607b5edd-5c0a-4869-8ba5-c6c421aa1b00 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:25.569308 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-9d2d193f-d2af-4662-9848-7d821cd1997e req-607b5edd-5c0a-4869-8ba5-c6c421aa1b00 service nova] Creating event network-vif-deleted:f5acb90a-f577-4063-9575-472c6b002484 for instance 7b67751f-bbbc-48cc-9286-3312b89f746d on hv-cinder-79987 Jul 28 04:11:25.574727 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-9d2d193f-d2af-4662-9848-7d821cd1997e req-607b5edd-5c0a-4869-8ba5-c6c421aa1b00 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042490 Jul 28 04:11:25.575566 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 568/1072] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:11:25.857560 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-ac447255-9a20-4b52-b62d-5e6528109c01 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:25.858200 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-ac447255-9a20-4b52-b62d-5e6528109c01 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:25.865420 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ac447255-9a20-4b52-b62d-5e6528109c01 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:25.865872 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ac447255-9a20-4b52-b62d-5e6528109c01 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:25.866635 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ac447255-9a20-4b52-b62d-5e6528109c01 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:25.867116 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ac447255-9a20-4b52-b62d-5e6528109c01 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:25.901060 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ac447255-9a20-4b52-b62d-5e6528109c01 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:25.901516 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ac447255-9a20-4b52-b62d-5e6528109c01 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:25.901964 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.objects.instance [None req-ac447255-9a20-4b52-b62d-5e6528109c01 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lazy-loading 'fault' on Instance uuid 7b67751f-bbbc-48cc-9286-3312b89f746d {{(pid=118186) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:11:25.946979 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-ac447255-9a20-4b52-b62d-5e6528109c01 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:25.964601 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-ac447255-9a20-4b52-b62d-5e6528109c01 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:25.966114 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-ac447255-9a20-4b52-b62d-5e6528109c01 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b7e6ceb0f76d41ce962efd065ffa3d5a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '901cf93dff224196b6727a29f0038bdb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:11:25.967334 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-ac447255-9a20-4b52-b62d-5e6528109c01 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 200 len: 1372 microversion: 2.20 time: 0.113868 Jul 28 04:11:25.967902 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 505/1073] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:11:25 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 1372 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 28 04:11:26.992490 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e1716685-849c-4cb8-b00f-0323942d9433 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:26.993186 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-e1716685-849c-4cb8-b00f-0323942d9433 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:26.999352 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e1716685-849c-4cb8-b00f-0323942d9433 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:26.999794 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e1716685-849c-4cb8-b00f-0323942d9433 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:27.000542 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e1716685-849c-4cb8-b00f-0323942d9433 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:27.000971 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-e1716685-849c-4cb8-b00f-0323942d9433 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:27.013968 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-e1716685-849c-4cb8-b00f-0323942d9433 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] HTTP exception thrown: Instance 7b67751f-bbbc-48cc-9286-3312b89f746d could not be found. Jul 28 04:11:27.015595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e1716685-849c-4cb8-b00f-0323942d9433 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Request method failure captured: Jul 28 04:11:27.015595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d HTTP/1.1 Jul 28 04:11:27.015595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:11:27.015595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:11:27.015595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:11:27.015595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:11:27.015595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:11:27.015595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:11:27.015595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:11:27.015595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:11:27.015595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gsSLBIwCkjWGVWiAAxQvkoAA-Lh2Nrbf3kSC5qt-AIzx6GfsSO3Jm8efkjl_jg_m8-CRu8Fl4S1VS8YpdGrqXn9HRBd8Y7Rowxp-kC9D5fLXpu1YoUub4I9ivGNakN7WAfSAWUdiEGoP3cCrehvGHlIoPYxC0xFon84y82UgiXpODw Jul 28 04:11:27.015595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:11:27.015595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:11:27.015595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:11:27.015595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:11:27.015595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 04:11:27.015595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:11:27.015595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:11:27.015595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 901cf93dff224196b6727a29f0038bdb Jul 28 04:11:27.015595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1608463631 Jul 28 04:11:27.015595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:11:27.015595 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:11:27.017339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_901cf93dff224196b6727a29f0038bdb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/901cf93dff224196b6727a29f0038bdb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/901cf93dff224196b6727a29f0038bdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/901cf93dff224196b6727a29f0038bdb"}]}] Jul 28 04:11:27.017339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1608463631 Jul 28 04:11:27.017339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 901cf93dff224196b6727a29f0038bdb Jul 28 04:11:27.017339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1608463631 Jul 28 04:11:27.017339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeShelveTestJSON-1608463631-project Jul 28 04:11:27.017339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:11:27.017339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:11:27.017339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: b7e6ceb0f76d41ce962efd065ffa3d5a Jul 28 04:11:27.017339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1608463631-project Jul 28 04:11:27.017339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:11:27.017339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Instance 7b67751f-bbbc-48cc-9286-3312b89f746d could not be found. Jul 28 04:11:27.017339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': '7b67751f-bbbc-48cc-9286-3312b89f746d'} Jul 28 04:11:27.018306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:11:27.018306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:27.018306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:11:27.018306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:11:27.018306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:11:27.018306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:11:27.018306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:11:27.018306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:11:27.018306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:11:27.018306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:11:27.018306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b67751f-bbbc-48cc-9286-3312b89f746d could not be found. Jul 28 04:11:27.018306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:11:27.018306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:11:27.018306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:11:27.018306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:27.018306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:11:27.018306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:11:27.018306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:11:27.018306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:11:27.018306 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:11:27.019909 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:11:27.019909 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:11:27.019909 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:11:27.019909 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:11:27.019909 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:11:27.019909 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:11:27.019909 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:11:27.019909 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b67751f-bbbc-48cc-9286-3312b89f746d could not be found. Jul 28 04:11:27.019909 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:11:27.019909 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:11:27.019909 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:11:27.019909 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:27.019909 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:11:27.019909 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:11:27.019909 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:11:27.019909 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:11:27.019909 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b67751f-bbbc-48cc-9286-3312b89f746d could not be found. Jul 28 04:11:27.019909 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:11:27.021843 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-e1716685-849c-4cb8-b00f-0323942d9433 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Returning 404 to user: Instance 7b67751f-bbbc-48cc-9286-3312b89f746d could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:11:27.021843 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-e1716685-849c-4cb8-b00f-0323942d9433 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 404 len: 111 microversion: 2.20 time: 0.029847 Jul 28 04:11:27.021843 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 569/1074] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:11:26 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 04:11:27.026444 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-e7ba7ce2-fbae-4b7d-8f18-47c349fa65b9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '.version_select at 0x7fa6ee0ed8b0>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:27.045473 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-e7ba7ce2-fbae-4b7d-8f18-47c349fa65b9 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1102715826" status: 204 len: 0 microversion: 2.20 time: 0.023005 Jul 28 04:11:27.046052 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 506/1075] 10.222.0.46 () {60 vars in 1262 bytes} [Thu Jul 28 04:11:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1102715826 => generated 0 bytes in 24 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 28 04:11:28.795206 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d2f7760f-f2e7-47ab-820c-4217c0fc864b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:28.795700 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-d2f7760f-f2e7-47ab-820c-4217c0fc864b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:28.802932 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d2f7760f-f2e7-47ab-820c-4217c0fc864b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:28.803381 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d2f7760f-f2e7-47ab-820c-4217c0fc864b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:28.804141 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d2f7760f-f2e7-47ab-820c-4217c0fc864b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:28.804573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-d2f7760f-f2e7-47ab-820c-4217c0fc864b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:28.818339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-d2f7760f-f2e7-47ab-820c-4217c0fc864b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] HTTP exception thrown: Instance 7b67751f-bbbc-48cc-9286-3312b89f746d could not be found. Jul 28 04:11:28.819878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d2f7760f-f2e7-47ab-820c-4217c0fc864b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Request method failure captured: Jul 28 04:11:28.819878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: DELETE /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d HTTP/1.1 Jul 28 04:11:28.819878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:11:28.819878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:11:28.819878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:11:28.819878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:11:28.819878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:11:28.819878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:11:28.819878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:11:28.819878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:11:28.819878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gsSLBIwCkjWGVWiAAxQvkoAA-Lh2Nrbf3kSC5qt-AIzx6GfsSO3Jm8efkjl_jg_m8-CRu8Fl4S1VS8YpdGrqXn9HRBd8Y7Rowxp-kC9D5fLXpu1YoUub4I9ivGNakN7WAfSAWUdiEGoP3cCrehvGHlIoPYxC0xFon84y82UgiXpODw Jul 28 04:11:28.819878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:11:28.819878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:11:28.819878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:11:28.819878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:11:28.819878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 04:11:28.819878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:11:28.819878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:11:28.819878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 901cf93dff224196b6727a29f0038bdb Jul 28 04:11:28.819878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1608463631 Jul 28 04:11:28.819878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:11:28.819878 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:11:28.821579 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_901cf93dff224196b6727a29f0038bdb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/901cf93dff224196b6727a29f0038bdb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/901cf93dff224196b6727a29f0038bdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/901cf93dff224196b6727a29f0038bdb"}]}] Jul 28 04:11:28.821579 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1608463631 Jul 28 04:11:28.821579 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 901cf93dff224196b6727a29f0038bdb Jul 28 04:11:28.821579 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1608463631 Jul 28 04:11:28.821579 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeShelveTestJSON-1608463631-project Jul 28 04:11:28.821579 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:11:28.821579 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:11:28.821579 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: b7e6ceb0f76d41ce962efd065ffa3d5a Jul 28 04:11:28.821579 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1608463631-project Jul 28 04:11:28.821579 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:11:28.821579 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Instance 7b67751f-bbbc-48cc-9286-3312b89f746d could not be found. Jul 28 04:11:28.821579 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': '7b67751f-bbbc-48cc-9286-3312b89f746d'} Jul 28 04:11:28.822485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:11:28.822485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:28.822485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:11:28.822485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:11:28.822485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:11:28.822485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:11:28.822485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:11:28.822485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:11:28.822485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:11:28.822485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:11:28.822485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b67751f-bbbc-48cc-9286-3312b89f746d could not be found. Jul 28 04:11:28.822485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:11:28.822485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:11:28.822485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:11:28.822485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:28.822485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:11:28.822485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:11:28.822485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:11:28.822485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:11:28.822485 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:11:28.823773 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:11:28.823773 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:11:28.823773 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:11:28.823773 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:11:28.823773 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:11:28.823773 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:11:28.823773 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:11:28.823773 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:11:28.823773 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:11:28.823773 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b67751f-bbbc-48cc-9286-3312b89f746d could not be found. Jul 28 04:11:28.823773 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:11:28.823773 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:11:28.823773 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:11:28.823773 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:28.823773 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:11:28.823773 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:11:28.823773 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:11:28.823773 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:11:28.823773 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b67751f-bbbc-48cc-9286-3312b89f746d could not be found. Jul 28 04:11:28.823773 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:11:28.825027 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-d2f7760f-f2e7-47ab-820c-4217c0fc864b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Returning 404 to user: Instance 7b67751f-bbbc-48cc-9286-3312b89f746d could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:11:28.825027 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-d2f7760f-f2e7-47ab-820c-4217c0fc864b tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "DELETE /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 404 len: 111 microversion: 2.20 time: 0.029962 Jul 28 04:11:28.825027 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 570/1076] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 04:11:28 2022] DELETE /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 04:11:28.830076 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-15391954-cc23-43be-8543-41f60aceffea tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:28.830700 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-15391954-cc23-43be-8543-41f60aceffea tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 7b67751f-bbbc-48cc-9286-3312b89f746d] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:28.837376 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-15391954-cc23-43be-8543-41f60aceffea tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:28.837850 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-15391954-cc23-43be-8543-41f60aceffea tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:28.838613 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-15391954-cc23-43be-8543-41f60aceffea tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:28.839083 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-15391954-cc23-43be-8543-41f60aceffea tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:28.852551 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.wsgi [None req-15391954-cc23-43be-8543-41f60aceffea tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] HTTP exception thrown: Instance 7b67751f-bbbc-48cc-9286-3312b89f746d could not be found. Jul 28 04:11:28.854206 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-15391954-cc23-43be-8543-41f60aceffea tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Request method failure captured: Jul 28 04:11:28.854206 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: request: GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d HTTP/1.1 Jul 28 04:11:28.854206 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept: application/json Jul 28 04:11:28.854206 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept-Encoding: identity Jul 28 04:11:28.854206 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Connection: close Jul 28 04:11:28.854206 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Length: 0 Jul 28 04:11:28.854206 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Type: application/json Jul 28 04:11:28.854206 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Host: 10.222.0.46 Jul 28 04:11:28.854206 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Openstack-System-Scope: None Jul 28 04:11:28.854206 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: User-Agent: python-urllib3/1.26.10 Jul 28 04:11:28.854206 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Auth-Token: gAAAAABi4gsSLBIwCkjWGVWiAAxQvkoAA-Lh2Nrbf3kSC5qt-AIzx6GfsSO3Jm8efkjl_jg_m8-CRu8Fl4S1VS8YpdGrqXn9HRBd8Y7Rowxp-kC9D5fLXpu1YoUub4I9ivGNakN7WAfSAWUdiEGoP3cCrehvGHlIoPYxC0xFon84y82UgiXpODw Jul 28 04:11:28.854206 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Id: None Jul 28 04:11:28.854206 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Name: None Jul 28 04:11:28.854206 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Identity-Status: Confirmed Jul 28 04:11:28.854206 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Is-Admin-Project: True Jul 28 04:11:28.854206 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 04:11:28.854206 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Id: default Jul 28 04:11:28.854206 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Name: Default Jul 28 04:11:28.854206 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Id: 901cf93dff224196b6727a29f0038bdb Jul 28 04:11:28.854206 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1608463631 Jul 28 04:11:28.854206 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Role: reader,member Jul 28 04:11:28.854206 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Roles: reader,member Jul 28 04:11:28.855955 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_901cf93dff224196b6727a29f0038bdb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/901cf93dff224196b6727a29f0038bdb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/901cf93dff224196b6727a29f0038bdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/901cf93dff224196b6727a29f0038bdb"}]}] Jul 28 04:11:28.855955 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1608463631 Jul 28 04:11:28.855955 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Id: 901cf93dff224196b6727a29f0038bdb Jul 28 04:11:28.855955 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1608463631 Jul 28 04:11:28.855955 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User: tempest-AttachVolumeShelveTestJSON-1608463631-project Jul 28 04:11:28.855955 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Id: default Jul 28 04:11:28.855955 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Name: Default Jul 28 04:11:28.855955 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Id: b7e6ceb0f76d41ce962efd065ffa3d5a Jul 28 04:11:28.855955 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1608463631-project Jul 28 04:11:28.855955 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: method: > Jul 28 04:11:28.855955 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: exception: Instance 7b67751f-bbbc-48cc-9286-3312b89f746d could not be found. Jul 28 04:11:28.855955 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: action_args: {'id': '7b67751f-bbbc-48cc-9286-3312b89f746d'} Jul 28 04:11:28.856780 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:11:28.856780 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:28.856780 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:11:28.856780 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:11:28.856780 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:11:28.856780 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:11:28.856780 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:11:28.856780 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:11:28.856780 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:11:28.856780 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:11:28.856780 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7b67751f-bbbc-48cc-9286-3312b89f746d could not be found. Jul 28 04:11:28.856780 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:11:28.856780 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:11:28.856780 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:11:28.856780 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:28.856780 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:11:28.856780 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:11:28.856780 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:11:28.856780 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:11:28.856780 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:11:28.858091 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:11:28.858091 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:11:28.858091 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:11:28.858091 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:11:28.858091 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:11:28.858091 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:11:28.858091 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:11:28.858091 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7b67751f-bbbc-48cc-9286-3312b89f746d could not be found. Jul 28 04:11:28.858091 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:11:28.858091 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:11:28.858091 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:11:28.858091 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:28.858091 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:11:28.858091 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:11:28.858091 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:11:28.858091 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:11:28.858091 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7b67751f-bbbc-48cc-9286-3312b89f746d could not be found. Jul 28 04:11:28.858091 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:11:28.859276 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-15391954-cc23-43be-8543-41f60aceffea tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Returning 404 to user: Instance 7b67751f-bbbc-48cc-9286-3312b89f746d could not be found. {{(pid=118186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:11:28.859276 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-15391954-cc23-43be-8543-41f60aceffea tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d" status: 404 len: 111 microversion: 2.20 time: 0.029898 Jul 28 04:11:28.859276 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 507/1077] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:11:28 2022] GET /compute/v2.1/servers/7b67751f-bbbc-48cc-9286-3312b89f746d => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 04:11:30.003840 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-58250b61-9d50-4c3d-908c-8621b36beb24 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:30.004325 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-58250b61-9d50-4c3d-908c-8621b36beb24 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:30.011635 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-58250b61-9d50-4c3d-908c-8621b36beb24 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:30.012081 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-58250b61-9d50-4c3d-908c-8621b36beb24 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:30.012837 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-58250b61-9d50-4c3d-908c-8621b36beb24 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:30.013268 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-58250b61-9d50-4c3d-908c-8621b36beb24 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:30.027421 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-58250b61-9d50-4c3d-908c-8621b36beb24 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] HTTP exception thrown: Instance 489708ab-f8bf-4f93-aa7a-907559b15d01 could not be found. Jul 28 04:11:30.028956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-58250b61-9d50-4c3d-908c-8621b36beb24 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Request method failure captured: Jul 28 04:11:30.028956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: DELETE /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 HTTP/1.1 Jul 28 04:11:30.028956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:11:30.028956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:11:30.028956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:11:30.028956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:11:30.028956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:11:30.028956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:11:30.028956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:11:30.028956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:11:30.028956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gsSLBIwCkjWGVWiAAxQvkoAA-Lh2Nrbf3kSC5qt-AIzx6GfsSO3Jm8efkjl_jg_m8-CRu8Fl4S1VS8YpdGrqXn9HRBd8Y7Rowxp-kC9D5fLXpu1YoUub4I9ivGNakN7WAfSAWUdiEGoP3cCrehvGHlIoPYxC0xFon84y82UgiXpODw Jul 28 04:11:30.028956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:11:30.028956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:11:30.028956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:11:30.028956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:11:30.028956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 04:11:30.028956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:11:30.028956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:11:30.028956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: 901cf93dff224196b6727a29f0038bdb Jul 28 04:11:30.028956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1608463631 Jul 28 04:11:30.028956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:11:30.028956 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:11:30.030640 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_901cf93dff224196b6727a29f0038bdb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/901cf93dff224196b6727a29f0038bdb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/901cf93dff224196b6727a29f0038bdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/901cf93dff224196b6727a29f0038bdb"}]}] Jul 28 04:11:30.030640 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1608463631 Jul 28 04:11:30.030640 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: 901cf93dff224196b6727a29f0038bdb Jul 28 04:11:30.030640 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1608463631 Jul 28 04:11:30.030640 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-AttachVolumeShelveTestJSON-1608463631-project Jul 28 04:11:30.030640 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:11:30.030640 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:11:30.030640 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: b7e6ceb0f76d41ce962efd065ffa3d5a Jul 28 04:11:30.030640 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1608463631-project Jul 28 04:11:30.030640 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:11:30.030640 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Instance 489708ab-f8bf-4f93-aa7a-907559b15d01 could not be found. Jul 28 04:11:30.030640 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': '489708ab-f8bf-4f93-aa7a-907559b15d01'} Jul 28 04:11:30.031687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:11:30.031687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:30.031687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:11:30.031687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:11:30.031687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:11:30.031687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:11:30.031687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:11:30.031687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:11:30.031687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:11:30.031687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:11:30.031687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 489708ab-f8bf-4f93-aa7a-907559b15d01 could not be found. Jul 28 04:11:30.031687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:11:30.031687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:11:30.031687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:11:30.031687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:30.031687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:11:30.031687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:11:30.031687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:11:30.031687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:11:30.031687 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:11:30.033155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:11:30.033155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 28 04:11:30.033155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 28 04:11:30.033155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 28 04:11:30.033155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 28 04:11:30.033155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:11:30.033155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:11:30.033155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:11:30.033155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:11:30.033155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 489708ab-f8bf-4f93-aa7a-907559b15d01 could not be found. Jul 28 04:11:30.033155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:11:30.033155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:11:30.033155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:11:30.033155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:30.033155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:11:30.033155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:11:30.033155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:11:30.033155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:11:30.033155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 489708ab-f8bf-4f93-aa7a-907559b15d01 could not be found. Jul 28 04:11:30.033155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:11:30.034752 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-58250b61-9d50-4c3d-908c-8621b36beb24 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Returning 404 to user: Instance 489708ab-f8bf-4f93-aa7a-907559b15d01 could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:11:30.034752 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-58250b61-9d50-4c3d-908c-8621b36beb24 tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "DELETE /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 404 len: 111 microversion: 2.20 time: 0.030353 Jul 28 04:11:30.034752 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 571/1078] 10.222.0.46 () {60 vars in 1280 bytes} [Thu Jul 28 04:11:29 2022] DELETE /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 04:11:30.039264 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a0e5c5db-f511-428a-87eb-418c9ec7a0ae tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:11:30.039888 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-a0e5c5db-f511-428a-87eb-418c9ec7a0ae tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] [instance: 489708ab-f8bf-4f93-aa7a-907559b15d01] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:11:30.046399 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a0e5c5db-f511-428a-87eb-418c9ec7a0ae tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:30.046877 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a0e5c5db-f511-428a-87eb-418c9ec7a0ae tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:30.047648 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a0e5c5db-f511-428a-87eb-418c9ec7a0ae tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:11:30.048081 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a0e5c5db-f511-428a-87eb-418c9ec7a0ae tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:11:30.062087 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.wsgi [None req-a0e5c5db-f511-428a-87eb-418c9ec7a0ae tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] HTTP exception thrown: Instance 489708ab-f8bf-4f93-aa7a-907559b15d01 could not be found. Jul 28 04:11:30.063657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a0e5c5db-f511-428a-87eb-418c9ec7a0ae tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Request method failure captured: Jul 28 04:11:30.063657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: request: GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 HTTP/1.1 Jul 28 04:11:30.063657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept: application/json Jul 28 04:11:30.063657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Accept-Encoding: identity Jul 28 04:11:30.063657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Connection: close Jul 28 04:11:30.063657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Length: 0 Jul 28 04:11:30.063657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Content-Type: application/json Jul 28 04:11:30.063657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Host: 10.222.0.46 Jul 28 04:11:30.063657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Openstack-System-Scope: None Jul 28 04:11:30.063657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: User-Agent: python-urllib3/1.26.10 Jul 28 04:11:30.063657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Auth-Token: gAAAAABi4gsSLBIwCkjWGVWiAAxQvkoAA-Lh2Nrbf3kSC5qt-AIzx6GfsSO3Jm8efkjl_jg_m8-CRu8Fl4S1VS8YpdGrqXn9HRBd8Y7Rowxp-kC9D5fLXpu1YoUub4I9ivGNakN7WAfSAWUdiEGoP3cCrehvGHlIoPYxC0xFon84y82UgiXpODw Jul 28 04:11:30.063657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Id: None Jul 28 04:11:30.063657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Domain-Name: None Jul 28 04:11:30.063657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Identity-Status: Confirmed Jul 28 04:11:30.063657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Is-Admin-Project: True Jul 28 04:11:30.063657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Openstack-Nova-Api-Version: 2.20 Jul 28 04:11:30.063657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Id: default Jul 28 04:11:30.063657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Domain-Name: Default Jul 28 04:11:30.063657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Id: 901cf93dff224196b6727a29f0038bdb Jul 28 04:11:30.063657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1608463631 Jul 28 04:11:30.063657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Role: reader,member Jul 28 04:11:30.063657 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Roles: reader,member Jul 28 04:11:30.065328 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_901cf93dff224196b6727a29f0038bdb", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/901cf93dff224196b6727a29f0038bdb"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/901cf93dff224196b6727a29f0038bdb"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/901cf93dff224196b6727a29f0038bdb"}]}] Jul 28 04:11:30.065328 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1608463631 Jul 28 04:11:30.065328 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Id: 901cf93dff224196b6727a29f0038bdb Jul 28 04:11:30.065328 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1608463631 Jul 28 04:11:30.065328 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User: tempest-AttachVolumeShelveTestJSON-1608463631-project Jul 28 04:11:30.065328 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Id: default Jul 28 04:11:30.065328 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Domain-Name: Default Jul 28 04:11:30.065328 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Id: b7e6ceb0f76d41ce962efd065ffa3d5a Jul 28 04:11:30.065328 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1608463631-project Jul 28 04:11:30.065328 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: method: > Jul 28 04:11:30.065328 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: exception: Instance 489708ab-f8bf-4f93-aa7a-907559b15d01 could not be found. Jul 28 04:11:30.065328 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: action_args: {'id': '489708ab-f8bf-4f93-aa7a-907559b15d01'} Jul 28 04:11:30.066215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:11:30.066215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:30.066215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:11:30.066215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:11:30.066215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:11:30.066215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:11:30.066215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:11:30.066215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:11:30.066215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:11:30.066215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:11:30.066215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 489708ab-f8bf-4f93-aa7a-907559b15d01 could not be found. Jul 28 04:11:30.066215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:11:30.066215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:11:30.066215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:11:30.066215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:30.066215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:11:30.066215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:11:30.066215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:11:30.066215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:11:30.066215 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:11:30.068288 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:11:30.068288 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:11:30.068288 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:11:30.068288 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:11:30.068288 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:11:30.068288 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:11:30.068288 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:11:30.068288 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 489708ab-f8bf-4f93-aa7a-907559b15d01 could not be found. Jul 28 04:11:30.068288 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:11:30.068288 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:11:30.068288 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:11:30.068288 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:11:30.068288 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:11:30.068288 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:11:30.068288 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:11:30.068288 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:11:30.068288 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 489708ab-f8bf-4f93-aa7a-907559b15d01 could not be found. Jul 28 04:11:30.068288 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR nova.api.openstack.wsgi Jul 28 04:11:30.069738 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a0e5c5db-f511-428a-87eb-418c9ec7a0ae tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] Returning 404 to user: Instance 489708ab-f8bf-4f93-aa7a-907559b15d01 could not be found. {{(pid=118186) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:11:30.069738 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-a0e5c5db-f511-428a-87eb-418c9ec7a0ae tempest-AttachVolumeShelveTestJSON-1608463631 tempest-AttachVolumeShelveTestJSON-1608463631-project] 10.222.0.46 "GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01" status: 404 len: 111 microversion: 2.20 time: 0.030188 Jul 28 04:11:30.069738 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 508/1079] 10.222.0.46 () {60 vars in 1277 bytes} [Thu Jul 28 04:11:30 2022] GET /compute/v2.1/servers/489708ab-f8bf-4f93-aa7a-907559b15d01 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 28 04:12:16.008826 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=12 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:16.010085 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=20 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:16.206518 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-09ed9025-4b77-4ae2-9975-c4ff919bbbd6 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Action: 'create', calling method: .version_select at 0x7fa6ee087790>, body: {"keypair": {"name": "tempest-TestShelveInstance-689856578", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPFz13UOXa79yyUaQZT3Lr7FEG3yT+N7rp1TVSs59Y2gbwirRhcq/p8nuO5bd5xvI41Awp0AAHP0mNoW6gF5YAE81VLUO6/xOP81ZRtpbTRzlW2JVaOaex1bzKAWGU5EtA=="}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:16.222623 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-09ed9025-4b77-4ae2-9975-c4ff919bbbd6 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Getting quotas for project c5bbf3cb340045809e176d501f0ff27f. Resources: {'key_pairs'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:12:16.226530 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.quota [None req-09ed9025-4b77-4ae2-9975-c4ff919bbbd6 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Getting quotas for user 93681c22430d4b88bdb1d6bae885f73d and project c5bbf3cb340045809e176d501f0ff27f. Resources: {'key_pairs'} {{(pid=118187) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:12:16.253522 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-09ed9025-4b77-4ae2-9975-c4ff919bbbd6 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.250329 Jul 28 04:12:16.254307 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 572/1080] 10.222.0.46 () {60 vars in 1159 bytes} [Thu Jul 28 04:12:16 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:31.466828 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:31.467584 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=32,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:31.471623 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-abe53771-a5df-44e1-9b09-c81655bac476 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-853321147", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-689856578", "security_groups": [{"name": "tempest-secgroup-smoke-5324541"}], "networks": [{"uuid": "85f460da-4a27-451e-8f59-06007a684adc"}], "block_device_mapping_v2": [{"uuid": "2c1b6633-ef6b-4801-8f4e-89608b04e2ab", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:31.587624 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.network.neutron [None req-abe53771-a5df-44e1-9b09-c81655bac476 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] validate_networks() for [('85f460da-4a27-451e-8f59-06007a684adc', None, None, None, None, None)] {{(pid=118186) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 28 04:12:32.047204 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-abe53771-a5df-44e1-9b09-c81655bac476 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Flavor limits 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 28 04:12:32.047635 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-abe53771-a5df-44e1-9b09-c81655bac476 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Image limits 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 28 04:12:32.048116 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-abe53771-a5df-44e1-9b09-c81655bac476 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Flavor pref 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 28 04:12:32.048530 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-abe53771-a5df-44e1-9b09-c81655bac476 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Image pref 0:0:0 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 28 04:12:32.048946 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.virt.hardware [None req-abe53771-a5df-44e1-9b09-c81655bac476 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118186) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 28 04:12:32.058052 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-abe53771-a5df-44e1-9b09-c81655bac476 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:32.058662 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-abe53771-a5df-44e1-9b09-c81655bac476 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:32.059464 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-abe53771-a5df-44e1-9b09-c81655bac476 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:32.060049 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-abe53771-a5df-44e1-9b09-c81655bac476 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:32.076454 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-abe53771-a5df-44e1-9b09-c81655bac476 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Getting quotas for project c5bbf3cb340045809e176d501f0ff27f. Resources: {'instances', 'cores', 'ram'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 28 04:12:32.080431 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.quota [None req-abe53771-a5df-44e1-9b09-c81655bac476 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Getting quotas for user 93681c22430d4b88bdb1d6bae885f73d and project c5bbf3cb340045809e176d501f0ff27f. Resources: {'instances', 'cores', 'ram'} {{(pid=118186) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 28 04:12:32.137193 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-abe53771-a5df-44e1-9b09-c81655bac476 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Going to run 1 instances... {{(pid=118186) _provision_instances /opt/stack/nova/nova/compute/api.py:1392}} Jul 28 04:12:32.139334 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-abe53771-a5df-44e1-9b09-c81655bac476 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='2c1b6633-ef6b-4801-8f4e-89608b04e2ab',volume_size=None,volume_type=None)] {{(pid=118186) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1810}} Jul 28 04:12:32.267255 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-abe53771-a5df-44e1-9b09-c81655bac476 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.803048 Jul 28 04:12:32.267902 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 509/1081] 10.222.0.46 () {60 vars in 1147 bytes} [Thu Jul 28 04:12:31 2022] POST /compute/v2.1/servers => generated 403 bytes in 804 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 28 04:12:32.276044 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=4 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:32.277117 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:32.281683 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-31216942-6f3b-450f-8159-11d3f8eff578 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:32.282304 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-31216942-6f3b-450f-8159-11d3f8eff578 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:12:32.345971 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-31216942-6f3b-450f-8159-11d3f8eff578 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:32.352780 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-31216942-6f3b-450f-8159-11d3f8eff578 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1087 microversion: 2.1 time: 0.078161 Jul 28 04:12:32.353361 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 573/1082] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:32 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1087 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:33.374853 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-81e71264-2ee3-46f6-a009-930c14812769 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:33.375624 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-81e71264-2ee3-46f6-a009-930c14812769 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:12:33.382576 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-81e71264-2ee3-46f6-a009-930c14812769 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:33.383210 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-81e71264-2ee3-46f6-a009-930c14812769 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:33.384183 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-81e71264-2ee3-46f6-a009-930c14812769 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:33.384631 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-81e71264-2ee3-46f6-a009-930c14812769 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:33.461521 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-81e71264-2ee3-46f6-a009-930c14812769 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:33.469075 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-81e71264-2ee3-46f6-a009-930c14812769 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1203 microversion: 2.1 time: 0.099528 Jul 28 04:12:33.469654 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 510/1083] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:33 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1203 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:34.491175 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9e9ddaa3-e2b2-4da6-a671-126ca489a4ee tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:34.492384 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9e9ddaa3-e2b2-4da6-a671-126ca489a4ee tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:12:34.499766 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9e9ddaa3-e2b2-4da6-a671-126ca489a4ee tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:34.500216 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9e9ddaa3-e2b2-4da6-a671-126ca489a4ee tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:34.500982 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9e9ddaa3-e2b2-4da6-a671-126ca489a4ee tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:34.501412 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9e9ddaa3-e2b2-4da6-a671-126ca489a4ee tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:34.581637 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-60dccb3d-c072-4e53-a62a-2de9693e4d59 req-9041a6e3-05a2-40bd-9d54-bb75394a182b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe", "tag": "197ef6f7-61f4-4ac0-99c3-6c2665ccbe5a"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:34.596473 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-60dccb3d-c072-4e53-a62a-2de9693e4d59 req-9041a6e3-05a2-40bd-9d54-bb75394a182b service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:34.596842 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-60dccb3d-c072-4e53-a62a-2de9693e4d59 req-9041a6e3-05a2-40bd-9d54-bb75394a182b service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:34.623467 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-60dccb3d-c072-4e53-a62a-2de9693e4d59 req-9041a6e3-05a2-40bd-9d54-bb75394a182b service nova] Creating event network-changed:197ef6f7-61f4-4ac0-99c3-6c2665ccbe5a for instance 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe on hv-cinder-79987 Jul 28 04:12:34.629935 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-60dccb3d-c072-4e53-a62a-2de9693e4d59 req-9041a6e3-05a2-40bd-9d54-bb75394a182b service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052023 Jul 28 04:12:34.631779 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 511/1084] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:34.668203 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9e9ddaa3-e2b2-4da6-a671-126ca489a4ee tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:34.676727 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9e9ddaa3-e2b2-4da6-a671-126ca489a4ee tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1256 microversion: 2.1 time: 0.190983 Jul 28 04:12:34.677304 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 574/1085] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:34 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1256 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:35.699387 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-b1387279-17f2-47f4-a9d4-8ada11dab811 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:35.700196 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-b1387279-17f2-47f4-a9d4-8ada11dab811 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:12:35.706901 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b1387279-17f2-47f4-a9d4-8ada11dab811 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:35.707350 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b1387279-17f2-47f4-a9d4-8ada11dab811 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:35.708132 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b1387279-17f2-47f4-a9d4-8ada11dab811 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:35.708567 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-b1387279-17f2-47f4-a9d4-8ada11dab811 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:35.972450 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-b1387279-17f2-47f4-a9d4-8ada11dab811 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:35.979908 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-b1387279-17f2-47f4-a9d4-8ada11dab811 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1256 microversion: 2.1 time: 0.285309 Jul 28 04:12:35.980694 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 512/1086] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:35 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1256 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:37.000966 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-bec4ed45-f326-437f-b152-f02b5e5d1da7 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:37.001582 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-bec4ed45-f326-437f-b152-f02b5e5d1da7 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:12:37.008056 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bec4ed45-f326-437f-b152-f02b5e5d1da7 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:37.008500 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bec4ed45-f326-437f-b152-f02b5e5d1da7 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:37.009252 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bec4ed45-f326-437f-b152-f02b5e5d1da7 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:37.009683 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-bec4ed45-f326-437f-b152-f02b5e5d1da7 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:37.138713 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-bec4ed45-f326-437f-b152-f02b5e5d1da7 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:37.146069 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-bec4ed45-f326-437f-b152-f02b5e5d1da7 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1256 microversion: 2.1 time: 0.149550 Jul 28 04:12:37.146623 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 575/1087] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:36 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1256 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:38.167404 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-307703f8-943a-4472-b2d2-cbb825ab5450 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:38.168018 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-307703f8-943a-4472-b2d2-cbb825ab5450 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:12:38.175774 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-307703f8-943a-4472-b2d2-cbb825ab5450 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:38.176229 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-307703f8-943a-4472-b2d2-cbb825ab5450 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:38.176993 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-307703f8-943a-4472-b2d2-cbb825ab5450 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:38.177434 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-307703f8-943a-4472-b2d2-cbb825ab5450 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:38.313324 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-307703f8-943a-4472-b2d2-cbb825ab5450 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:38.320806 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-307703f8-943a-4472-b2d2-cbb825ab5450 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1256 microversion: 2.1 time: 0.157531 Jul 28 04:12:38.321374 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 513/1088] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:38 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1256 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:39.342228 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-55560e47-3c48-4233-bc35-405faf0c7dfb tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:39.342876 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-55560e47-3c48-4233-bc35-405faf0c7dfb tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:12:39.349350 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55560e47-3c48-4233-bc35-405faf0c7dfb tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:39.349805 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55560e47-3c48-4233-bc35-405faf0c7dfb tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:39.350622 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55560e47-3c48-4233-bc35-405faf0c7dfb tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:39.351105 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-55560e47-3c48-4233-bc35-405faf0c7dfb tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:39.493677 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-55560e47-3c48-4233-bc35-405faf0c7dfb tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:39.502734 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-55560e47-3c48-4233-bc35-405faf0c7dfb tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1256 microversion: 2.1 time: 0.164907 Jul 28 04:12:39.503346 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 576/1089] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:39 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1256 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:40.524341 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-a70f6a7a-6b33-460c-a5cb-1a60e2aee844 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:40.524968 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-a70f6a7a-6b33-460c-a5cb-1a60e2aee844 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:12:40.532226 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a70f6a7a-6b33-460c-a5cb-1a60e2aee844 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:40.532688 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a70f6a7a-6b33-460c-a5cb-1a60e2aee844 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:40.533460 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a70f6a7a-6b33-460c-a5cb-1a60e2aee844 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:40.533902 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-a70f6a7a-6b33-460c-a5cb-1a60e2aee844 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:40.669604 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-a70f6a7a-6b33-460c-a5cb-1a60e2aee844 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:40.677102 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-a70f6a7a-6b33-460c-a5cb-1a60e2aee844 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1256 microversion: 2.1 time: 0.157067 Jul 28 04:12:40.677675 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 514/1090] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:40 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1256 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:41.697553 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ee549ad4-94da-4895-bdfb-386521a42ba6 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:41.698072 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ee549ad4-94da-4895-bdfb-386521a42ba6 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:12:41.704658 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ee549ad4-94da-4895-bdfb-386521a42ba6 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:41.705100 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ee549ad4-94da-4895-bdfb-386521a42ba6 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:41.705850 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ee549ad4-94da-4895-bdfb-386521a42ba6 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:41.706282 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ee549ad4-94da-4895-bdfb-386521a42ba6 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:41.835334 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ee549ad4-94da-4895-bdfb-386521a42ba6 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:41.843058 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ee549ad4-94da-4895-bdfb-386521a42ba6 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1256 microversion: 2.1 time: 0.149410 Jul 28 04:12:41.843635 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 577/1091] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:41 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1256 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:42.863118 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-4e345cdd-f815-4501-a345-09fd7778cd0a tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:42.863736 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-4e345cdd-f815-4501-a345-09fd7778cd0a tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:12:42.866131 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell0:SELECT=2 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:42.866845 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell0:SELECT=6 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:42.873625 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4e345cdd-f815-4501-a345-09fd7778cd0a tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:42.874074 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4e345cdd-f815-4501-a345-09fd7778cd0a tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:42.874877 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4e345cdd-f815-4501-a345-09fd7778cd0a tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:42.875318 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-4e345cdd-f815-4501-a345-09fd7778cd0a tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:43.004209 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-4e345cdd-f815-4501-a345-09fd7778cd0a tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:43.011585 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-4e345cdd-f815-4501-a345-09fd7778cd0a tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1256 microversion: 2.1 time: 0.152465 Jul 28 04:12:43.012201 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 515/1092] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:42 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1256 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:44.032481 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-b6d1b279-377b-4c51-8245-93e83277f4e4 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:44.033039 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-b6d1b279-377b-4c51-8245-93e83277f4e4 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:12:44.034897 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell0:SELECT=2 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:12:44.041094 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b6d1b279-377b-4c51-8245-93e83277f4e4 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:44.041550 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b6d1b279-377b-4c51-8245-93e83277f4e4 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:44.042309 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b6d1b279-377b-4c51-8245-93e83277f4e4 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:44.042742 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-b6d1b279-377b-4c51-8245-93e83277f4e4 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:44.177900 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-b6d1b279-377b-4c51-8245-93e83277f4e4 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:44.186034 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-b6d1b279-377b-4c51-8245-93e83277f4e4 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1256 microversion: 2.1 time: 0.157534 Jul 28 04:12:44.186832 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 578/1093] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:44 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1256 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:44.274210 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-860293b4-5f2f-454d-a560-7f6c0df33bab req-978e5be4-0937-4bee-b002-fa27078bcc57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe", "name": "network-vif-plugged", "status": "completed", "tag": "197ef6f7-61f4-4ac0-99c3-6c2665ccbe5a"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:44.284897 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-860293b4-5f2f-454d-a560-7f6c0df33bab req-978e5be4-0937-4bee-b002-fa27078bcc57 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:44.285350 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-860293b4-5f2f-454d-a560-7f6c0df33bab req-978e5be4-0937-4bee-b002-fa27078bcc57 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:44.297349 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-860293b4-5f2f-454d-a560-7f6c0df33bab req-978e5be4-0937-4bee-b002-fa27078bcc57 service nova] Creating event network-vif-plugged:197ef6f7-61f4-4ac0-99c3-6c2665ccbe5a for instance 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe on hv-cinder-79987 Jul 28 04:12:44.302244 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-860293b4-5f2f-454d-a560-7f6c0df33bab req-978e5be4-0937-4bee-b002-fa27078bcc57 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031742 Jul 28 04:12:44.302862 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 516/1094] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:12:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:12:45.206641 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-3fdd0ad2-d769-494a-9b71-313487624ff8 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:45.207278 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-3fdd0ad2-d769-494a-9b71-313487624ff8 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:12:45.213711 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3fdd0ad2-d769-494a-9b71-313487624ff8 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:45.214159 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3fdd0ad2-d769-494a-9b71-313487624ff8 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:45.214986 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3fdd0ad2-d769-494a-9b71-313487624ff8 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:45.215890 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-3fdd0ad2-d769-494a-9b71-313487624ff8 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:45.347089 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-3fdd0ad2-d769-494a-9b71-313487624ff8 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:45.354585 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-3fdd0ad2-d769-494a-9b71-313487624ff8 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1256 microversion: 2.1 time: 0.151797 Jul 28 04:12:45.355180 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 579/1095] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:45 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1256 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:46.376209 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-f5e483aa-0e62-4ff4-a8f4-c10c72f1ee76 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:46.376913 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-f5e483aa-0e62-4ff4-a8f4-c10c72f1ee76 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:12:46.383561 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f5e483aa-0e62-4ff4-a8f4-c10c72f1ee76 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:46.384013 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f5e483aa-0e62-4ff4-a8f4-c10c72f1ee76 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:46.384780 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f5e483aa-0e62-4ff4-a8f4-c10c72f1ee76 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:46.385217 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-f5e483aa-0e62-4ff4-a8f4-c10c72f1ee76 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:46.520031 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-f5e483aa-0e62-4ff4-a8f4-c10c72f1ee76 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:46.527645 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-f5e483aa-0e62-4ff4-a8f4-c10c72f1ee76 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1441 microversion: 2.1 time: 0.156692 Jul 28 04:12:46.528378 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 517/1096] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:46 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1441 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:46.548470 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-50237776-02c4-4f00-a94c-5c2578006a41 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:12:46.549116 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-50237776-02c4-4f00-a94c-5c2578006a41 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:12:46.555774 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-50237776-02c4-4f00-a94c-5c2578006a41 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:46.556234 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-50237776-02c4-4f00-a94c-5c2578006a41 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:46.557009 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-50237776-02c4-4f00-a94c-5c2578006a41 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:46.557453 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-50237776-02c4-4f00-a94c-5c2578006a41 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:46.686924 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-50237776-02c4-4f00-a94c-5c2578006a41 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:12:46.694371 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-50237776-02c4-4f00-a94c-5c2578006a41 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1441 microversion: 2.1 time: 0.150240 Jul 28 04:12:46.694969 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 580/1097] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:12:46 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1441 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:12:48.558659 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [req-f787ea97-10c7-44d3-bba9-407596f1b1fb req-54e09300-b0bd-4359-ab24-45c4c2e53e6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe", "tag": "197ef6f7-61f4-4ac0-99c3-6c2665ccbe5a"}]} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:12:48.569570 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-f787ea97-10c7-44d3-bba9-407596f1b1fb req-54e09300-b0bd-4359-ab24-45c4c2e53e6d service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:12:48.569944 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [req-f787ea97-10c7-44d3-bba9-407596f1b1fb req-54e09300-b0bd-4359-ab24-45c4c2e53e6d service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:12:48.582016 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.compute.server_external_events [req-f787ea97-10c7-44d3-bba9-407596f1b1fb req-54e09300-b0bd-4359-ab24-45c4c2e53e6d service nova] Creating event network-changed:197ef6f7-61f4-4ac0-99c3-6c2665ccbe5a for instance 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe on hv-cinder-79987 Jul 28 04:12:48.587159 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [req-f787ea97-10c7-44d3-bba9-407596f1b1fb req-54e09300-b0bd-4359-ab24-45c4c2e53e6d service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032222 Jul 28 04:12:48.587798 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 518/1098] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:13:05.271659 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:13:05.272276 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Thu Jul 28 04:13:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:14:37.309522 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:14:37.310245 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Thu Jul 28 04:14:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:14:43.740389 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=18 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:14:43.741155 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=42 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:14:43.745167 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-249c5db8-d8fd-4ba1-8149-8f37e1513299 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:43.745704 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-249c5db8-d8fd-4ba1-8149-8f37e1513299 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:14:43.753246 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-249c5db8-d8fd-4ba1-8149-8f37e1513299 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:43.753700 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-249c5db8-d8fd-4ba1-8149-8f37e1513299 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:43.754466 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-249c5db8-d8fd-4ba1-8149-8f37e1513299 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:43.754950 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-249c5db8-d8fd-4ba1-8149-8f37e1513299 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:43.777472 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.objects.instance [None req-249c5db8-d8fd-4ba1-8149-8f37e1513299 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lazy-loading 'flavor' on Instance uuid 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe {{(pid=118187) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 28 04:14:43.849222 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-249c5db8-d8fd-4ba1-8149-8f37e1513299 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "POST /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe/action" status: 202 len: 0 microversion: 2.1 time: 0.110573 Jul 28 04:14:43.849799 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 581/1099] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Jul 28 04:14:43 2022] POST /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:14:43.856346 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: ERROR oslo.messaging._drivers.impl_rabbit [-] [eb24d0fb-ee22-44c4-99a5-46d872f1051f] AMQP server on 10.222.0.46:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 28 04:14:43.858036 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:14:43.859724 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=44 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:14:43.864402 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-2b4e7403-9faa-4653-b4fd-ad80742b7570 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:43.865102 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-2b4e7403-9faa-4653-b4fd-ad80742b7570 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:14:43.873255 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2b4e7403-9faa-4653-b4fd-ad80742b7570 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:43.873786 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2b4e7403-9faa-4653-b4fd-ad80742b7570 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:43.874467 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2b4e7403-9faa-4653-b4fd-ad80742b7570 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:43.874925 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2b4e7403-9faa-4653-b4fd-ad80742b7570 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:44.056300 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-2b4e7403-9faa-4653-b4fd-ad80742b7570 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:44.064413 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-2b4e7403-9faa-4653-b4fd-ad80742b7570 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1566 microversion: 2.1 time: 0.210086 Jul 28 04:14:44.064968 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 519/1100] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:43 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1566 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:44.758042 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:14:44.758265 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Thu Jul 28 04:14:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:14:45.085794 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-9d46f1e7-8bff-48eb-bf0d-37dc7c64f946 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:45.086536 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-9d46f1e7-8bff-48eb-bf0d-37dc7c64f946 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:14:45.094019 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9d46f1e7-8bff-48eb-bf0d-37dc7c64f946 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:45.094469 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9d46f1e7-8bff-48eb-bf0d-37dc7c64f946 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:45.095275 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9d46f1e7-8bff-48eb-bf0d-37dc7c64f946 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:45.095716 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-9d46f1e7-8bff-48eb-bf0d-37dc7c64f946 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:45.228538 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-9d46f1e7-8bff-48eb-bf0d-37dc7c64f946 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:45.236667 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-9d46f1e7-8bff-48eb-bf0d-37dc7c64f946 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1566 microversion: 2.1 time: 0.155153 Jul 28 04:14:45.237247 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 582/1101] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:45 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:45.593014 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:14:45.593647 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Thu Jul 28 04:14:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:14:46.258014 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-da7e8783-6cb1-4d4e-9041-7f5e0753f5da tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:46.258655 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-da7e8783-6cb1-4d4e-9041-7f5e0753f5da tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:14:46.271274 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO oslo.messaging._drivers.impl_rabbit [-] [eb24d0fb-ee22-44c4-99a5-46d872f1051f] Reconnected to AMQP server on 10.222.0.46:5672 via [amqp] client with port 49342. Jul 28 04:14:46.272797 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-da7e8783-6cb1-4d4e-9041-7f5e0753f5da tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:46.273280 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-da7e8783-6cb1-4d4e-9041-7f5e0753f5da tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:46.274055 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-da7e8783-6cb1-4d4e-9041-7f5e0753f5da tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:46.274491 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-da7e8783-6cb1-4d4e-9041-7f5e0753f5da tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:46.405042 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-da7e8783-6cb1-4d4e-9041-7f5e0753f5da tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:46.412704 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-da7e8783-6cb1-4d4e-9041-7f5e0753f5da tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1566 microversion: 2.1 time: 0.158571 Jul 28 04:14:46.413267 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 520/1102] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:46 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:47.435056 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-6ea3b641-8d82-47bf-98f4-1b15266bbb67 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:47.435790 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-6ea3b641-8d82-47bf-98f4-1b15266bbb67 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:14:47.442304 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6ea3b641-8d82-47bf-98f4-1b15266bbb67 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:47.442756 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6ea3b641-8d82-47bf-98f4-1b15266bbb67 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:47.443547 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6ea3b641-8d82-47bf-98f4-1b15266bbb67 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:47.443984 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-6ea3b641-8d82-47bf-98f4-1b15266bbb67 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:47.572513 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-6ea3b641-8d82-47bf-98f4-1b15266bbb67 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:47.580698 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-6ea3b641-8d82-47bf-98f4-1b15266bbb67 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1566 microversion: 2.1 time: 0.149515 Jul 28 04:14:47.581261 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 583/1103] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:47 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1566 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:48.602332 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-ab9aafee-a7f6-499a-a35e-5e8d2d686c23 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:48.602910 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-ab9aafee-a7f6-499a-a35e-5e8d2d686c23 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:14:48.610396 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ab9aafee-a7f6-499a-a35e-5e8d2d686c23 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:48.610871 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ab9aafee-a7f6-499a-a35e-5e8d2d686c23 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:48.611646 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ab9aafee-a7f6-499a-a35e-5e8d2d686c23 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:48.612085 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-ab9aafee-a7f6-499a-a35e-5e8d2d686c23 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:48.745901 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-ab9aafee-a7f6-499a-a35e-5e8d2d686c23 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:48.753637 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-ab9aafee-a7f6-499a-a35e-5e8d2d686c23 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1566 microversion: 2.1 time: 0.155282 Jul 28 04:14:48.754200 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 521/1104] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:48 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:49.774761 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-dcd9bbe8-79bd-450e-9914-be512733bfa2 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:49.775325 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-dcd9bbe8-79bd-450e-9914-be512733bfa2 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:14:49.781953 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dcd9bbe8-79bd-450e-9914-be512733bfa2 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:49.782400 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dcd9bbe8-79bd-450e-9914-be512733bfa2 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:49.783186 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dcd9bbe8-79bd-450e-9914-be512733bfa2 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:49.783624 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-dcd9bbe8-79bd-450e-9914-be512733bfa2 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:49.912464 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-dcd9bbe8-79bd-450e-9914-be512733bfa2 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:49.921138 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-dcd9bbe8-79bd-450e-9914-be512733bfa2 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1566 microversion: 2.1 time: 0.150326 Jul 28 04:14:49.921707 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 584/1105] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:49 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:50.942388 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-1339bd5e-67d4-40cc-aa60-1c784e5059c0 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:50.943031 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-1339bd5e-67d4-40cc-aa60-1c784e5059c0 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:14:50.949462 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1339bd5e-67d4-40cc-aa60-1c784e5059c0 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:50.949911 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1339bd5e-67d4-40cc-aa60-1c784e5059c0 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:50.951343 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1339bd5e-67d4-40cc-aa60-1c784e5059c0 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:50.951734 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-1339bd5e-67d4-40cc-aa60-1c784e5059c0 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:51.082501 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-1339bd5e-67d4-40cc-aa60-1c784e5059c0 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:51.090104 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-1339bd5e-67d4-40cc-aa60-1c784e5059c0 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1566 microversion: 2.1 time: 0.151757 Jul 28 04:14:51.090672 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 522/1106] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:50 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:52.111616 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-90b01678-e800-46a0-87b0-aa548b075d31 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:52.112240 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-90b01678-e800-46a0-87b0-aa548b075d31 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:14:52.118238 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-90b01678-e800-46a0-87b0-aa548b075d31 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:52.118693 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-90b01678-e800-46a0-87b0-aa548b075d31 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:52.119491 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-90b01678-e800-46a0-87b0-aa548b075d31 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:52.119931 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-90b01678-e800-46a0-87b0-aa548b075d31 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:52.252555 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-90b01678-e800-46a0-87b0-aa548b075d31 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:52.260021 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-90b01678-e800-46a0-87b0-aa548b075d31 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1566 microversion: 2.1 time: 0.152530 Jul 28 04:14:52.260586 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 585/1107] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:52 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:53.282251 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-00755092-68f3-47e1-876e-db9304f175bb tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:53.282974 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-00755092-68f3-47e1-876e-db9304f175bb tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:14:53.289521 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-00755092-68f3-47e1-876e-db9304f175bb tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:53.289965 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-00755092-68f3-47e1-876e-db9304f175bb tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:53.290725 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-00755092-68f3-47e1-876e-db9304f175bb tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:53.291440 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-00755092-68f3-47e1-876e-db9304f175bb tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:53.425406 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-00755092-68f3-47e1-876e-db9304f175bb tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:53.432818 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-00755092-68f3-47e1-876e-db9304f175bb tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1566 microversion: 2.1 time: 0.155208 Jul 28 04:14:53.433377 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 523/1108] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:53 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:54.454033 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-aef1ee19-75a0-4e5b-bc91-dfb4de4f3791 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:54.454768 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-aef1ee19-75a0-4e5b-bc91-dfb4de4f3791 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:14:54.461499 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aef1ee19-75a0-4e5b-bc91-dfb4de4f3791 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:54.461958 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aef1ee19-75a0-4e5b-bc91-dfb4de4f3791 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:54.462730 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aef1ee19-75a0-4e5b-bc91-dfb4de4f3791 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:54.463237 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-aef1ee19-75a0-4e5b-bc91-dfb4de4f3791 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:54.597258 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-aef1ee19-75a0-4e5b-bc91-dfb4de4f3791 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:54.604834 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-aef1ee19-75a0-4e5b-bc91-dfb4de4f3791 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1566 microversion: 2.1 time: 0.155250 Jul 28 04:14:54.605404 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 586/1109] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:54 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:55.627049 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-256c0405-fcaf-4ed5-aa5a-75d1c6de5604 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:55.627664 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-256c0405-fcaf-4ed5-aa5a-75d1c6de5604 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:14:55.634202 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-256c0405-fcaf-4ed5-aa5a-75d1c6de5604 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:55.634653 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-256c0405-fcaf-4ed5-aa5a-75d1c6de5604 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:55.635443 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-256c0405-fcaf-4ed5-aa5a-75d1c6de5604 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:55.635875 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-256c0405-fcaf-4ed5-aa5a-75d1c6de5604 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:55.767569 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-256c0405-fcaf-4ed5-aa5a-75d1c6de5604 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:55.775063 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-256c0405-fcaf-4ed5-aa5a-75d1c6de5604 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1566 microversion: 2.1 time: 0.152306 Jul 28 04:14:55.775641 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 524/1110] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:55 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:56.796356 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-befae338-8d12-4b38-9173-00e97a7eaead tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:56.796973 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-befae338-8d12-4b38-9173-00e97a7eaead tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:14:56.803473 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-befae338-8d12-4b38-9173-00e97a7eaead tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:56.803916 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-befae338-8d12-4b38-9173-00e97a7eaead tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:56.804667 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-befae338-8d12-4b38-9173-00e97a7eaead tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:56.805100 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-befae338-8d12-4b38-9173-00e97a7eaead tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:56.991125 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-befae338-8d12-4b38-9173-00e97a7eaead tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:56.999568 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-befae338-8d12-4b38-9173-00e97a7eaead tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1507 microversion: 2.1 time: 0.207150 Jul 28 04:14:57.000142 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 587/1111] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:56 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1507 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:57.020311 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-5148d437-7bd7-4635-b001-dc3a1728990c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:57.020911 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-5148d437-7bd7-4635-b001-dc3a1728990c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:14:57.027401 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5148d437-7bd7-4635-b001-dc3a1728990c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:57.027850 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5148d437-7bd7-4635-b001-dc3a1728990c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:57.028627 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5148d437-7bd7-4635-b001-dc3a1728990c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:57.029340 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-5148d437-7bd7-4635-b001-dc3a1728990c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:57.057735 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-5148d437-7bd7-4635-b001-dc3a1728990c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=118186) unshelve /opt/stack/nova/nova/compute/api.py:4532}} Jul 28 04:14:57.122057 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-5148d437-7bd7-4635-b001-dc3a1728990c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "POST /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe/action" status: 202 len: 0 microversion: 2.1 time: 0.105527 Jul 28 04:14:57.123494 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 525/1112] 10.222.0.46 () {60 vars in 1278 bytes} [Thu Jul 28 04:14:57 2022] POST /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe/action => generated 0 bytes in 107 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:14:57.131390 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-4cee9c45-02a3-4459-8bbf-efc13e53200c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:57.132037 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-4cee9c45-02a3-4459-8bbf-efc13e53200c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:14:57.138942 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4cee9c45-02a3-4459-8bbf-efc13e53200c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:57.139587 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4cee9c45-02a3-4459-8bbf-efc13e53200c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:57.140190 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4cee9c45-02a3-4459-8bbf-efc13e53200c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:57.140631 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-4cee9c45-02a3-4459-8bbf-efc13e53200c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:57.307801 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-4cee9c45-02a3-4459-8bbf-efc13e53200c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:57.316133 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-4cee9c45-02a3-4459-8bbf-efc13e53200c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1515 microversion: 2.1 time: 0.188642 Jul 28 04:14:57.316707 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 588/1113] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:57 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1515 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:58.337134 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-478f2533-f621-46ab-8359-a3299222b34c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:58.337741 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-478f2533-f621-46ab-8359-a3299222b34c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:14:58.344007 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-478f2533-f621-46ab-8359-a3299222b34c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:58.344454 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-478f2533-f621-46ab-8359-a3299222b34c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:58.345203 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-478f2533-f621-46ab-8359-a3299222b34c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:58.345636 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-478f2533-f621-46ab-8359-a3299222b34c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:58.479490 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-478f2533-f621-46ab-8359-a3299222b34c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:58.487359 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-478f2533-f621-46ab-8359-a3299222b34c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1573 microversion: 2.1 time: 0.154501 Jul 28 04:14:58.487942 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 526/1114] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:58 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1573 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:58.969644 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-3a803fd1-3b5d-4f47-9522-397e320e1531 req-a7a7479e-2b8f-4095-b6da-e095f7792e02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe", "name": "network-vif-unplugged", "status": "completed", "tag": "197ef6f7-61f4-4ac0-99c3-6c2665ccbe5a"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:14:58.979999 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-3a803fd1-3b5d-4f47-9522-397e320e1531 req-a7a7479e-2b8f-4095-b6da-e095f7792e02 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:58.980704 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-3a803fd1-3b5d-4f47-9522-397e320e1531 req-a7a7479e-2b8f-4095-b6da-e095f7792e02 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:58.993657 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-3a803fd1-3b5d-4f47-9522-397e320e1531 req-a7a7479e-2b8f-4095-b6da-e095f7792e02 service nova] Creating event network-vif-unplugged:197ef6f7-61f4-4ac0-99c3-6c2665ccbe5a for instance 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe on hv-cinder-79987 Jul 28 04:14:58.999642 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-3a803fd1-3b5d-4f47-9522-397e320e1531 req-a7a7479e-2b8f-4095-b6da-e095f7792e02 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034287 Jul 28 04:14:59.000242 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 589/1115] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:14:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:14:59.509167 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-fa48dc28-bee2-4be2-9045-ef4ab2c32530 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:14:59.509913 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-fa48dc28-bee2-4be2-9045-ef4ab2c32530 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:14:59.516976 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fa48dc28-bee2-4be2-9045-ef4ab2c32530 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:59.517421 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fa48dc28-bee2-4be2-9045-ef4ab2c32530 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:59.518182 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fa48dc28-bee2-4be2-9045-ef4ab2c32530 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:14:59.518618 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-fa48dc28-bee2-4be2-9045-ef4ab2c32530 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:14:59.649760 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-fa48dc28-bee2-4be2-9045-ef4ab2c32530 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:14:59.658118 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-fa48dc28-bee2-4be2-9045-ef4ab2c32530 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1573 microversion: 2.1 time: 0.152793 Jul 28 04:14:59.658687 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 527/1116] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:14:59 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:14:59.783449 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:14:59.783637 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Thu Jul 28 04:14:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:15:00.680976 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-713a0c5c-010f-4569-a45b-92894ac88955 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:00.681677 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-713a0c5c-010f-4569-a45b-92894ac88955 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:15:00.688095 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-713a0c5c-010f-4569-a45b-92894ac88955 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:00.688544 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-713a0c5c-010f-4569-a45b-92894ac88955 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:00.689295 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-713a0c5c-010f-4569-a45b-92894ac88955 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:00.689727 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-713a0c5c-010f-4569-a45b-92894ac88955 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:00.817671 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-713a0c5c-010f-4569-a45b-92894ac88955 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:00.825114 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-713a0c5c-010f-4569-a45b-92894ac88955 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1573 microversion: 2.1 time: 0.148890 Jul 28 04:15:00.825674 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 590/1117] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:00 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:01.846080 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-210e27cc-154e-4cfc-b733-a86b778922c5 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:01.846702 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-210e27cc-154e-4cfc-b733-a86b778922c5 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:15:01.853252 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-210e27cc-154e-4cfc-b733-a86b778922c5 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:01.853704 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-210e27cc-154e-4cfc-b733-a86b778922c5 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:01.854467 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-210e27cc-154e-4cfc-b733-a86b778922c5 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:01.854942 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-210e27cc-154e-4cfc-b733-a86b778922c5 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:01.987974 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-210e27cc-154e-4cfc-b733-a86b778922c5 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:01.995491 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-210e27cc-154e-4cfc-b733-a86b778922c5 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1573 microversion: 2.1 time: 0.153903 Jul 28 04:15:01.996063 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 528/1118] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:01 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:03.016879 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-260e8710-43e9-444e-82eb-42250c2f65ec tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:03.017561 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-260e8710-43e9-444e-82eb-42250c2f65ec tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:15:03.024069 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-260e8710-43e9-444e-82eb-42250c2f65ec tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:03.024522 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-260e8710-43e9-444e-82eb-42250c2f65ec tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:03.025286 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-260e8710-43e9-444e-82eb-42250c2f65ec tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:03.025727 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-260e8710-43e9-444e-82eb-42250c2f65ec tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:03.157230 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-260e8710-43e9-444e-82eb-42250c2f65ec tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:03.164869 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-260e8710-43e9-444e-82eb-42250c2f65ec tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1573 microversion: 2.1 time: 0.152471 Jul 28 04:15:03.165436 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 591/1119] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:03 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:04.187480 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-70ba608e-c1a1-4467-846c-e63fee49c0c4 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:04.188012 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-70ba608e-c1a1-4467-846c-e63fee49c0c4 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:15:04.194572 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-70ba608e-c1a1-4467-846c-e63fee49c0c4 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:04.195063 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-70ba608e-c1a1-4467-846c-e63fee49c0c4 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:04.195825 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-70ba608e-c1a1-4467-846c-e63fee49c0c4 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:04.196263 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-70ba608e-c1a1-4467-846c-e63fee49c0c4 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:04.324393 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-70ba608e-c1a1-4467-846c-e63fee49c0c4 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:04.332339 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-70ba608e-c1a1-4467-846c-e63fee49c0c4 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1573 microversion: 2.1 time: 0.149441 Jul 28 04:15:04.332913 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 529/1120] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:04 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:05.353811 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-59ab2f45-3ffa-428e-9ee7-269bcebc327c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:05.354443 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-59ab2f45-3ffa-428e-9ee7-269bcebc327c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:15:05.361664 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-59ab2f45-3ffa-428e-9ee7-269bcebc327c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:05.362117 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-59ab2f45-3ffa-428e-9ee7-269bcebc327c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:05.362912 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-59ab2f45-3ffa-428e-9ee7-269bcebc327c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:05.363356 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-59ab2f45-3ffa-428e-9ee7-269bcebc327c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:05.495704 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-59ab2f45-3ffa-428e-9ee7-269bcebc327c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:05.503244 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-59ab2f45-3ffa-428e-9ee7-269bcebc327c tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1573 microversion: 2.1 time: 0.153251 Jul 28 04:15:05.503802 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 592/1121] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:05 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:06.525092 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-9beae2ad-6f96-46ab-9fd8-260eaeb96dca tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:15:06.525728 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-9beae2ad-6f96-46ab-9fd8-260eaeb96dca tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:15:06.532495 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9beae2ad-6f96-46ab-9fd8-260eaeb96dca tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:06.532944 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9beae2ad-6f96-46ab-9fd8-260eaeb96dca tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:06.533710 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9beae2ad-6f96-46ab-9fd8-260eaeb96dca tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:06.534143 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-9beae2ad-6f96-46ab-9fd8-260eaeb96dca tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:06.667338 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-9beae2ad-6f96-46ab-9fd8-260eaeb96dca tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:15:06.674985 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-9beae2ad-6f96-46ab-9fd8-260eaeb96dca tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1560 microversion: 2.1 time: 0.153789 Jul 28 04:15:06.675550 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 530/1122] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:15:06 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1560 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:15:09.068818 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-7678e952-fe3e-422a-804d-62b7ac061b4b req-fda340c8-8065-4acd-adbb-2ffa0d3a9659 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe", "name": "network-vif-plugged", "status": "completed", "tag": "197ef6f7-61f4-4ac0-99c3-6c2665ccbe5a"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:15:09.080049 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-7678e952-fe3e-422a-804d-62b7ac061b4b req-fda340c8-8065-4acd-adbb-2ffa0d3a9659 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:15:09.080511 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-7678e952-fe3e-422a-804d-62b7ac061b4b req-fda340c8-8065-4acd-adbb-2ffa0d3a9659 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:15:09.092265 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-7678e952-fe3e-422a-804d-62b7ac061b4b req-fda340c8-8065-4acd-adbb-2ffa0d3a9659 service nova] Creating event network-vif-plugged:197ef6f7-61f4-4ac0-99c3-6c2665ccbe5a for instance 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe on hv-cinder-79987 Jul 28 04:15:09.097311 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-7678e952-fe3e-422a-804d-62b7ac061b4b req-fda340c8-8065-4acd-adbb-2ffa0d3a9659 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032246 Jul 28 04:15:09.097989 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 593/1123] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:16:22.951702 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_api:SELECT=26 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:16:22.952437 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG dbcounter [-] [118187] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118187) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:16:22.954239 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:16:22.955231 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG dbcounter [-] [118186] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118186) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 28 04:16:22.959202 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-94c8873e-771c-41d0-96da-6fd45c7aaa01 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:22.959698 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-94c8873e-771c-41d0-96da-6fd45c7aaa01 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:16:22.974958 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-94c8873e-771c-41d0-96da-6fd45c7aaa01 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:22.975381 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-94c8873e-771c-41d0-96da-6fd45c7aaa01 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:22.976155 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-94c8873e-771c-41d0-96da-6fd45c7aaa01 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:22.976588 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-94c8873e-771c-41d0-96da-6fd45c7aaa01 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:23.005788 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-94c8873e-771c-41d0-96da-6fd45c7aaa01 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Going to try to terminate instance {{(pid=118186) delete /opt/stack/nova/nova/compute/api.py:2667}} Jul 28 04:16:23.026909 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-9098fb4c-1eb9-4346-bd48-576c094d8c73 req-0eb586be-8192-44c6-8b30-f52a641988ae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe", "tag": "197ef6f7-61f4-4ac0-99c3-6c2665ccbe5a"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:16:23.037041 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-9098fb4c-1eb9-4346-bd48-576c094d8c73 req-0eb586be-8192-44c6-8b30-f52a641988ae service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:23.037574 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-9098fb4c-1eb9-4346-bd48-576c094d8c73 req-0eb586be-8192-44c6-8b30-f52a641988ae service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:23.051633 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-9098fb4c-1eb9-4346-bd48-576c094d8c73 req-0eb586be-8192-44c6-8b30-f52a641988ae service nova] Creating event network-changed:197ef6f7-61f4-4ac0-99c3-6c2665ccbe5a for instance 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe on hv-cinder-79987 Jul 28 04:16:23.060616 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-9098fb4c-1eb9-4346-bd48-576c094d8c73 req-0eb586be-8192-44c6-8b30-f52a641988ae service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110467 Jul 28 04:16:23.061156 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 594/1124] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:16:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:16:23.091018 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-94c8873e-771c-41d0-96da-6fd45c7aaa01 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "DELETE /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 204 len: 0 microversion: 2.1 time: 0.142995 Jul 28 04:16:23.095003 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 531/1125] 10.222.0.46 () {58 vars in 1239 bytes} [Thu Jul 28 04:16:22 2022] DELETE /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 28 04:16:23.101729 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-ee804c73-41be-4c90-945a-45f008af6b05 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:23.103137 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-ee804c73-41be-4c90-945a-45f008af6b05 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:16:23.109630 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ee804c73-41be-4c90-945a-45f008af6b05 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:23.110092 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ee804c73-41be-4c90-945a-45f008af6b05 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:23.110908 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ee804c73-41be-4c90-945a-45f008af6b05 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:23.111354 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-ee804c73-41be-4c90-945a-45f008af6b05 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:23.246244 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.policy [None req-ee804c73-41be-4c90-945a-45f008af6b05 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118187) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:23.254573 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-ee804c73-41be-4c90-945a-45f008af6b05 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1566 microversion: 2.1 time: 0.157368 Jul 28 04:16:23.255179 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 595/1126] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:23 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1566 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:24.279729 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-49c63390-fbb1-4784-892c-51126190ec50 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:24.280444 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-49c63390-fbb1-4784-892c-51126190ec50 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:16:24.287124 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-49c63390-fbb1-4784-892c-51126190ec50 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:24.287581 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-49c63390-fbb1-4784-892c-51126190ec50 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:24.288349 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-49c63390-fbb1-4784-892c-51126190ec50 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:24.288783 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-49c63390-fbb1-4784-892c-51126190ec50 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:24.453139 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-49c63390-fbb1-4784-892c-51126190ec50 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:24.460819 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-49c63390-fbb1-4784-892c-51126190ec50 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1566 microversion: 2.1 time: 0.185954 Jul 28 04:16:24.461552 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 532/1127] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:24 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1566 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 28 04:16:25.280883 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:16:25.281561 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Thu Jul 28 04:16:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:16:25.483171 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-2adb20de-e811-45f9-9f8a-39d9ce1d77d7 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:25.483908 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.compute.api [None req-2adb20de-e811-45f9-9f8a-39d9ce1d77d7 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118186) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:16:25.490279 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2adb20de-e811-45f9-9f8a-39d9ce1d77d7 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:25.490729 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2adb20de-e811-45f9-9f8a-39d9ce1d77d7 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:25.491540 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2adb20de-e811-45f9-9f8a-39d9ce1d77d7 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:25.491971 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG oslo_concurrency.lockutils [None req-2adb20de-e811-45f9-9f8a-39d9ce1d77d7 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118186) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:25.505278 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [req-22d3579e-0cc3-422a-804e-564258e22473 req-6f3735f9-9bd6-4625-bca3-784611bc3856 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe", "name": "network-vif-deleted", "tag": "197ef6f7-61f4-4ac0-99c3-6c2665ccbe5a"}]} {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 28 04:16:25.516418 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-22d3579e-0cc3-422a-804e-564258e22473 req-6f3735f9-9bd6-4625-bca3-784611bc3856 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:25.516866 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [req-22d3579e-0cc3-422a-804e-564258e22473 req-6f3735f9-9bd6-4625-bca3-784611bc3856 service nova] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:25.531184 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.compute.server_external_events [req-22d3579e-0cc3-422a-804e-564258e22473 req-6f3735f9-9bd6-4625-bca3-784611bc3856 service nova] Creating event network-vif-deleted:197ef6f7-61f4-4ac0-99c3-6c2665ccbe5a for instance 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe on hv-cinder-79987 Jul 28 04:16:25.536085 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [req-22d3579e-0cc3-422a-804e-564258e22473 req-6f3735f9-9bd6-4625-bca3-784611bc3856 service nova] 10.222.0.46 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094712 Jul 28 04:16:25.536995 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 596/1128] 10.222.0.46 () {64 vars in 1317 bytes} [Thu Jul 28 04:16:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 28 04:16:25.569983 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.policy [None req-2adb20de-e811-45f9-9f8a-39d9ce1d77d7 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '93681c22430d4b88bdb1d6bae885f73d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c5bbf3cb340045809e176d501f0ff27f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118186) authorize /opt/stack/nova/nova/policy.py:199}} Jul 28 04:16:25.577784 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-2adb20de-e811-45f9-9f8a-39d9ce1d77d7 tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 200 len: 1218 microversion: 2.1 time: 0.099564 Jul 28 04:16:25.578356 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 533/1129] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:25 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 28 04:16:26.599131 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a7aba106-9308-47b0-8408-bf6dc9ed2afa tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '>' {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:26.599852 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.compute.api [None req-a7aba106-9308-47b0-8408-bf6dc9ed2afa tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] [instance: 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe] Fetching instance by UUID {{(pid=118187) get /opt/stack/nova/nova/compute/api.py:2923}} Jul 28 04:16:26.606468 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7aba106-9308-47b0-8408-bf6dc9ed2afa tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:26.606960 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7aba106-9308-47b0-8408-bf6dc9ed2afa tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:26.607730 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7aba106-9308-47b0-8408-bf6dc9ed2afa tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 28 04:16:26.608170 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG oslo_concurrency.lockutils [None req-a7aba106-9308-47b0-8408-bf6dc9ed2afa tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Lock "914ca376-756b-4795-b8c4-6a0f18f31607" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118187) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 28 04:16:26.621026 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.wsgi [None req-a7aba106-9308-47b0-8408-bf6dc9ed2afa tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] HTTP exception thrown: Instance 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe could not be found. Jul 28 04:16:26.622685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a7aba106-9308-47b0-8408-bf6dc9ed2afa tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Request method failure captured: Jul 28 04:16:26.622685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: request: GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe HTTP/1.1 Jul 28 04:16:26.622685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept: application/json Jul 28 04:16:26.622685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Accept-Encoding: identity Jul 28 04:16:26.622685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Connection: close Jul 28 04:16:26.622685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Length: 0 Jul 28 04:16:26.622685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Content-Type: application/json Jul 28 04:16:26.622685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Host: 10.222.0.46 Jul 28 04:16:26.622685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Openstack-System-Scope: None Jul 28 04:16:26.622685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: User-Agent: python-urllib3/1.26.10 Jul 28 04:16:26.622685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Auth-Token: gAAAAABi4gyaYuphh7xS0aYi10BWZU_UsCJEgLcOfxBd2hPOBwcgnGw-cveQ-gs7MseSQzKHjY4xwLHx_ZUEpFxwZ51YkAnQ1W0d84i73aN58CHUC9s5ktS2fLfEAsY128FVLBwnh7xDeGwQG5c4ax5JQmbxv6JoUH8-91_F1UN5_lYMgwhebAA Jul 28 04:16:26.622685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Id: None Jul 28 04:16:26.622685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Domain-Name: None Jul 28 04:16:26.622685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Identity-Status: Confirmed Jul 28 04:16:26.622685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Is-Admin-Project: True Jul 28 04:16:26.622685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Id: default Jul 28 04:16:26.622685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Domain-Name: Default Jul 28 04:16:26.622685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Id: c5bbf3cb340045809e176d501f0ff27f Jul 28 04:16:26.622685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Project-Name: tempest-TestShelveInstance-877203206 Jul 28 04:16:26.622685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Role: reader,member Jul 28 04:16:26.622685 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Roles: reader,member Jul 28 04:16:26.624481 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:8080/v1/AUTH_c5bbf3cb340045809e176d501f0ff27f", "adminURL": "http://10.222.0.46:8080"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c5bbf3cb340045809e176d501f0ff27f"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/volume/v3/c5bbf3cb340045809e176d501f0ff27f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/placement"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46:9696/"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.46/compute/v2/c5bbf3cb340045809e176d501f0ff27f"}]}] Jul 28 04:16:26.624481 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant: tempest-TestShelveInstance-877203206 Jul 28 04:16:26.624481 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Id: c5bbf3cb340045809e176d501f0ff27f Jul 28 04:16:26.624481 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-Tenant-Name: tempest-TestShelveInstance-877203206 Jul 28 04:16:26.624481 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User: tempest-TestShelveInstance-877203206-project Jul 28 04:16:26.624481 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Id: default Jul 28 04:16:26.624481 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Domain-Name: Default Jul 28 04:16:26.624481 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Id: 93681c22430d4b88bdb1d6bae885f73d Jul 28 04:16:26.624481 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: X-User-Name: tempest-TestShelveInstance-877203206-project Jul 28 04:16:26.624481 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: method: > Jul 28 04:16:26.624481 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: exception: Instance 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe could not be found. Jul 28 04:16:26.624481 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: action_args: {'id': '8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe'} Jul 28 04:16:26.625587 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: {{(pid=118187) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 28 04:16:26.625587 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:16:26.625587 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 28 04:16:26.625587 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 28 04:16:26.625587 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2926, in get Jul 28 04:16:26.625587 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 28 04:16:26.625587 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2873, in _get_instance Jul 28 04:16:26.625587 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 28 04:16:26.625587 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2830, in _get_instance_from_cell Jul 28 04:16:26.625587 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 28 04:16:26.625587 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe could not be found. Jul 28 04:16:26.625587 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:16:26.625587 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:16:26.625587 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:16:26.625587 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:16:26.625587 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:16:26.625587 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:16:26.625587 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 28 04:16:26.625587 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 28 04:16:26.625587 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 28 04:16:26.627339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 28 04:16:26.627339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 28 04:16:26.627339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 28 04:16:26.627339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 28 04:16:26.627339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 28 04:16:26.627339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 28 04:16:26.627339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 28 04:16:26.627339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe could not be found. Jul 28 04:16:26.627339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:16:26.627339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 28 04:16:26.627339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:16:26.627339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 28 04:16:26.627339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 28 04:16:26.627339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 28 04:16:26.627339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 28 04:16:26.627339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 28 04:16:26.627339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe could not be found. Jul 28 04:16:26.627339 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: ERROR nova.api.openstack.wsgi Jul 28 04:16:26.628935 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: DEBUG nova.api.openstack.wsgi [None req-a7aba106-9308-47b0-8408-bf6dc9ed2afa tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Returning 404 to user: Instance 8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe could not be found. {{(pid=118187) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 28 04:16:26.628935 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO nova.api.openstack.requestlog [None req-a7aba106-9308-47b0-8408-bf6dc9ed2afa tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe" status: 404 len: 111 microversion: 2.1 time: 0.029266 Jul 28 04:16:26.628935 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: [pid: 118187|app: 0|req: 597/1130] 10.222.0.46 () {58 vars in 1236 bytes} [Thu Jul 28 04:16:26 2022] GET /compute/v2.1/servers/8101a6e5-cbab-48df-a7c9-ce3c5c5c7bbe => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 28 04:16:26.786729 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: DEBUG nova.api.openstack.wsgi [None req-87e98938-777f-4557-a4d0-d1c095d6dece tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] Calling method '.version_select at 0x7fa6eec42d30>' {{(pid=118186) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 28 04:16:26.813180 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO nova.api.openstack.requestlog [None req-87e98938-777f-4557-a4d0-d1c095d6dece tempest-TestShelveInstance-877203206 tempest-TestShelveInstance-877203206-project] 10.222.0.46 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-689856578" status: 202 len: 0 microversion: 2.1 time: 0.030319 Jul 28 04:16:26.813759 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: [pid: 118186|app: 0|req: 534/1131] 10.222.0.46 () {58 vars in 1251 bytes} [Thu Jul 28 04:16:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-689856578 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 28 04:17:57.318158 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:17:57.318866 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Thu Jul 28 04:17:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:18:05.601056 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:18:05.601575 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Thu Jul 28 04:18:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:19:44.768102 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:19:44.768786 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Thu Jul 28 04:19:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:19:45.290350 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:19:45.290945 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Thu Jul 28 04:19:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:21:17.326506 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:21:17.327210 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Thu Jul 28 04:21:17 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:21:25.609304 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:21:25.609831 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Thu Jul 28 04:21:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:21:39.794869 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:21:39.795563 dv-cinder-799871-47-iscsi devstack@n-api.service[118186]: Thu Jul 28 04:21:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 28 04:21:41.637724 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 28 04:21:41.638246 dv-cinder-799871-47-iscsi devstack@n-api.service[118187]: Thu Jul 28 04:21:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!